Jul 11 03:44:27 devstack cinder-volume[76154]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 03:44:27 devstack cinder-volume[76154]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 03:44:27 devstack cinder-volume[76154]: we strongly recommend against using it for new projects. Jul 11 03:44:27 devstack cinder-volume[76154]: If you are already using Eventlet, we recommend migrating to a different Jul 11 03:44:27 devstack cinder-volume[76154]: framework. For more detail see Jul 11 03:44:27 devstack cinder-volume[76154]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 03:44:27 devstack cinder-volume[76154]: import eventlet # noqa Jul 11 03:44:30 devstack cinder-volume[76154]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76154) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:44:30 devstack cinder-volume[76154]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76154) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:44:30 devstack cinder-volume[76154]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76154) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:44:31 devstack cinder-volume[76154]: INFO dbcounter [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Registered counter for database cinder Jul 11 03:44:31 devstack cinder-volume[76154]: DEBUG oslo_db.sqlalchemy.engines [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76154) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:44:31 devstack cinder-volume[76154]: DEBUG dbcounter [-] [76154] Writer thread running {{(pid=76154) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 03:44:31 devstack cinder-volume[76154]: INFO cinder.rpc [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 03:44:31 devstack cinder-volume[76154]: INFO cinder.rpc [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 03:44:31 devstack cinder-volume[76154]: DEBUG oslo_db.sqlalchemy.engines [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76154) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:44:31 devstack cinder-volume[76154]: INFO cinder.volume.manager [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Determined volume DB was empty at startup. Jul 11 03:44:31 devstack cinder-volume[76154]: DEBUG cinder.volume.manager [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76154) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 03:44:31 devstack cinder-volume[76154]: INFO cinder.volume.manager [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 03:44:31 devstack cinder-volume[76154]: WARNING stevedore.named [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 03:44:31 devstack cinder-volume[76154]: WARNING castellan.key_manager [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:44:31 devstack cinder-volume[76154]: WARNING cinder.keymgr.conf_key_mgr [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:44:31 devstack cinder-volume[76154]: DEBUG cinder.volume.drivers.lvm [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76154) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 11 03:44:31 devstack cinder-volume[76154]: DEBUG oslo_concurrency.processutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76154) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_concurrency.processutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] CMD "cinder-rtstool verify" returned: 0 in 0.452s {{(pid=76154) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_db.sqlalchemy.engines [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76154) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:44:32 devstack cinder-volume[76154]: INFO cinder.rpc [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 11 03:44:32 devstack cinder-volume[76154]: INFO cinder.rpc [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 11 03:44:32 devstack cinder-volume[76154]: WARNING stevedore.named [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 03:44:32 devstack cinder-volume[76154]: WARNING castellan.key_manager [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:44:32 devstack cinder-volume[76154]: INFO cinder.volume.manager [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_db.sqlalchemy.engines [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76154) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:44:32 devstack cinder-volume[76154]: INFO oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Starting 1 workers Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Started child 76342 {{(pid=76154) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Full set of CONF: {{(pid=76154) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] ******************************************************************************** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Configuration options gathered from: {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 03:44:32 devstack cinder-volume[76342]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] ================================================================================ {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] allow_availability_zone_fallback = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] allow_compression_on_image_upload = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] allowed_direct_url_schemes = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] api_rate_limit = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] auth_strategy = keystone {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] az_cache_duration = 3600 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_availability_zone = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_host = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_stats_polling_interval = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backup_api_class = cinder.backup.api.API {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backup_name_template = backup-%s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backup_use_same_host = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backup_use_temp_snapshot = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] chap_password = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] chap_username = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_internal_tenant_project_id = eb8c6eb60ad6446e93c430472232ebde {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_internal_tenant_user_id = e4959b0b96054419ba08570ae946d0bc {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cloned_volume_same_az = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cluster = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] compression_format = gzip {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] compute_api_class = cinder.compute.nova.API {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] config_dir = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] config_source = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] control_exchange = openstack {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] debug = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] default_availability_zone = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] default_group_type = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] default_volume_type = lvmdriver-1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] disk_geometry = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] driver_client_cert = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] driver_client_cert_key = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] driver_data_namespace = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] driver_ssl_cert_path = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] driver_ssl_cert_verify = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] driver_use_ssl = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] enable_force_upload = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] enable_new_services = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] enable_unsupported_driver = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] enforce_multipath_for_image_xfer = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] filter_function = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_api_insecure = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_api_servers = ['http://192.168.122.161/image'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_api_ssl_compression = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_ca_certificates_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_catalog_info = image:glance:publicURL {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_num_retries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance_request_timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] goodness_function = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] graceful_shutdown_timeout = 5 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] group_api_class = cinder.group.api.API {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] host = devstack {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_compress_on_upload = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_conversion_address_space_limit = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_conversion_cpu_limit = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_conversion_disable = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_upload_use_cinder_backend = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_upload_use_internal_tenant = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_volume_cache_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_volume_cache_max_count = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] image_volume_cache_max_size_gb = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] init_host_max_objects_retrieval = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] instance_format = [instance: %(uuid)s] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] iscsi_target_flags = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] iscsi_write_cache = on {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] iser_helper = tgtadm {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] iser_ip_address = 192.168.122.161 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] iser_port = 3260 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_color = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_config_append = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_dir = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_options = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_rotate_interval = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_rotate_interval_type = days {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] log_rotation_type = none {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] max_age = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] max_logfile_count = 30 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] max_logfile_size_mb = 200 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] max_over_subscription_ratio = 20.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] message_reap_interval = 86400 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] message_ttl = 2592000 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] migration_create_volume_timeout_secs = 300 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] monkey_patch = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] monkey_patch_modules = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] my_ip = 192.168.122.161 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] no_snapshot_gb_quota = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] num_iser_scan_tries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] num_shell_tries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] num_volume_device_scan_tries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] nvmeof_conn_info_version = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] nvmet_ns_id = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] nvmet_port_id = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_max_limit = 1000 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_volume_ext_list = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_volume_listen_port = 8776 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_volume_use_ssl = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] osapi_volume_workers = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] per_volume_size_limit = -1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] periodic_fuzzy_delay = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] periodic_interval = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] public_endpoint = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] publish_errors = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_backup_gigabytes = 1000 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_backups = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_gigabytes = 1000 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_groups = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_snapshots = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] quota_volumes = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] rate_limit_burst = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] rate_limit_except_level = CRITICAL {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] rate_limit_interval = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] reinit_driver_count = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] replication_device = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] report_discard_supported = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] report_interval = 120 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] reservation_clean_interval = 86400 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] reservation_expire = 86400 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] reserved_image_namespaces = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] reserved_percentage = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] rpc_response_timeout = 120 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] run_external_periodic_tasks = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] scst_target_driver = iscsi {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] scst_target_iqn_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_down_time = 720 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] shell_completion = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] snapshot_name_template = snapshot-%s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] snapshot_same_host = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] split_loggers = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] state_path = /opt/stack/data/cinder {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] storage_availability_zone = nova {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] storage_protocol = iSCSI {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] syslog_log_facility = LOG_USER {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] target_helper = lioadm {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] target_ip_address = 192.168.122.161 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] target_port = 3260 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] target_protocol = iscsi {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] target_secondary_ip_addresses = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] trace_flags = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] transport_url = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] until_refresh = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_chap_auth = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_default_quota_class = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_journal = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_json = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_multipath_for_image_xfer = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_stderr = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] use_syslog = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] verify_glance_signatures = enabled {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_api_class = cinder.volume.api.API {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_backend_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_clear = zero {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_clear_ionice = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_clear_size = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_copy_bps_limit = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_dd_blocksize = 1M {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_name_template = volume-%s {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_service_inithost_offload = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volume_usage_audit_period = month {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] zoning_mode = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_concurrency.disable_process_locking = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.auth_section = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.auth_type = password {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.auth_version = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.cache = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.include_service_catalog = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.insecure = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.interface = public {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_password = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack sudo[76346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack sudo[76346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcache_username = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.region_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.service_type = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.161/identity {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.backend = dogpile.cache.null {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.backend_argument = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.backend_expiration_time = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.config_prefix = cache.oslo {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.debug_cache_backend = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.enable_retry_client = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.enable_socket_keepalive = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.expiration_time = 600 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.hashclient_retry_attempts = 2 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_dead_retry = 300 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_pool_maxsize = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_sasl_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.password = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.proxies = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.redis_db = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.redis_server = localhost:6379 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.retry_attempts = 2 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.retry_delay = 0.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.socket_keepalive_count = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.socket_keepalive_idle = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.socket_keepalive_interval = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.socket_timeout = 1.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.tls_allowed_ciphers = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.tls_cafile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.tls_certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.tls_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.tls_keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cache.username = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] coordination.backend_url = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.asyncio_connection = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.asyncio_slave_connection = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.backend = sqlalchemy {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.connection = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.connection_debug = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.connection_parameters = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.connection_recycle_time = 3600 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.connection_trace = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.db_inc_retry_interval = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.db_max_retries = 20 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.db_max_retry_interval = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.db_retry_interval = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.max_overflow = 50 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.max_pool_size = 5 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.max_retries = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.mysql_wsrep_sync_wait = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.pool_timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.retry_interval = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.slave_connection = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.sqlite_synchronous = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.synchronous_reader = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] database.use_db_reconnect = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.connection_string = messaging:// {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.es_doc_type = notification {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.es_scroll_size = 10000 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.es_scroll_time = 2m {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.filter_error_trace = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.hmac_keys = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.sentinel_service_name = mymaster {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.socket_timeout = 0.1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.trace_requests = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler.trace_sqlalchemy = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler_jaeger.process_tags = {} {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler_jaeger.service_name_prefix = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] profiler_otlp.service_name_prefix = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.enforce_new_defaults = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.enforce_scope = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.policy_default_rule = default {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.policy_file = policy.yaml {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.group = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.helper_command = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] privsep_osbrick.user = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.group = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.helper_command = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] cinder_sys_admin.user = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.auth_section = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.auth_type = password {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.cafile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.collect_timing = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.insecure = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.send_service_user_token = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.split_loggers = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] service_user.timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.auth_section = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.auth_type = password {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.collect_timing = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.insecure = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.region_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.split_loggers = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] glance.timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.backend_availability_zone = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.chap_password = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.chap_username = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.disk_geometry = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.driver_client_cert = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.driver_client_cert_key = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.driver_data_namespace = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.driver_use_ssl = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.extra_capabilities = {} {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.filter_function = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.goodness_function = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.iscsi_target_flags = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.iscsi_write_cache = on {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.iser_helper = tgtadm {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.iser_port = 3260 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.lvm_share_target = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.lvm_type = auto {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.num_shell_tries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.replication_device = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.report_discard_supported = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.reserved_percentage = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.target_helper = tgtadm {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.target_port = 3260 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.target_protocol = iscsi {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.trace_flags = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.unique_fqdn_network = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.use_chap_auth = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_backend_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_clear = zero {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_clear_ionice = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_clear_size = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_reports.file_event_handler = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_reports.log_dir = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.backend_host = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.chap_password = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.chap_username = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.disk_geometry = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.driver_client_cert = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.extra_capabilities = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.filter_function = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.goodness_function = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.iser_helper = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.iser_ip_address = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.iser_port = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.lvm_share_target = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.lvm_type = auto {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.num_shell_tries = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.replication_device = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.report_discard_supported = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.reserved_percentage = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.scst_target_driver = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.storage_protocol = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.target_helper = lioadm {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.target_ip_address = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.target_port = 3260 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.trace_flags = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.use_chap_auth = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_clear = zero {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_clear_size = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] lvmdriver-1.volumes_dir = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_notifications.driver = [] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_notifications.retry = -1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] key_manager.fixed_key = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.barbican_api_version = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.barbican_endpoint = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.barbican_endpoint_type = public {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.barbican_region_name = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.cafile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.collect_timing = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.insecure = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.number_of_retries = 60 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.retry_delay = 1 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.send_service_user_token = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.split_loggers = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.verify_ssl = True {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican.verify_ssl_path = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.auth_section = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.auth_type = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.cafile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.certfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.collect_timing = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.insecure = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.keyfile = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.split_loggers = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] barbican_service_user.timeout = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.approle_role_id = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.approle_secret_id = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.kv_mountpoint = secret {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.kv_path = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.kv_version = 2 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.namespace = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.root_token_id = **** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.ssl_ca_crt_file = None {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.timeout = 60.0 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.use_ssl = False {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:44:32 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] ******************************************************************************** {{(pid=76154) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 03:44:33 devstack sudo[76346]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:33 devstack sudo[76378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:33 devstack sudo[76378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:33 devstack sudo[76378]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.661s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 03:44:33 devstack cinder-volume[76342]: INFO cinder.brick.local_dev.lvm [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:33 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:33 devstack sudo[76628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:44:33 devstack sudo[76628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:34 devstack sudo[76628]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:34 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:34 devstack cinder-volume[76342]: DEBUG cinder.brick.local_dev.lvm [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76342) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 11 03:44:34 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:34 devstack sudo[76833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:34 devstack sudo[76833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:36 devstack sudo[76833]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.544s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:36 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:36 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:36 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.757s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:36 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:36 devstack sudo[77127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 11 03:44:36 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:37 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:37 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.811s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:37 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:37 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:44:37 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:38 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:38 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:38 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:38 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:44:38 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:39 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:39 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.771s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:39 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:39 devstack sudo[77147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:39 devstack sudo[77147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:39 devstack sudo[77147]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:39 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.765s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:39 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:40 devstack sudo[77155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:40 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:40 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:40 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:40 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:40 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:40 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:40 devstack sudo[77160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:40 devstack sudo[77160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:41 devstack sudo[77160]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:41 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:41 devstack cinder-volume[76342]: INFO cinder.volume.drivers.lvm [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 11 03:44:41 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:41 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:41 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:41 devstack sudo[77171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:41 devstack sudo[77171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:42 devstack sudo[77171]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:42 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.795s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:42 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:44:42 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:42 devstack sudo[77286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:44:42 devstack sudo[77286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:42 devstack cinder-volume[76154]: DEBUG dbcounter [-] [76154] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76154) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:44:42 devstack sudo[77286]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:42 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:42 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:42 devstack sudo[77399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:42 devstack sudo[77399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:43 devstack sudo[77399]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:43 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:43 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:43 devstack sudo[77431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:43 devstack sudo[77431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:44 devstack sudo[77431]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:44 devstack sudo[77434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:44 devstack sudo[77434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:44 devstack sudo[77434]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:44 devstack cinder-volume[76342]: INFO cinder.volume.driver [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG cinder.volume.driver [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76342) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG oslo_db.sqlalchemy.engines [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writer thread running {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG cinder.db.api [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Building query based on filter {{(pid=76342) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG cinder.image.image_utils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76342) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1300}} Jul 11 03:44:44 devstack cinder-volume[76342]: INFO cinder.keymgr.migration [None req-a3f50c00-2052-482f-9f62-e17713476df5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:44:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:44 devstack sudo[77443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:44:44 devstack sudo[77443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:45 devstack sudo[77443]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:45 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:45 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:45 devstack sudo[77447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:45 devstack sudo[77447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:46 devstack sudo[77447]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:46 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:46 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:46 devstack sudo[77450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:46 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:46 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:46 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:46 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:46 devstack sudo[77453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:46 devstack sudo[77453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:47 devstack sudo[77453]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:47 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:47 devstack cinder-volume[76342]: DEBUG cinder.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Notifying Schedulers of capabilities ... {{(pid=76342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:44:47 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Driver initialization completed successfully. Jul 11 03:44:47 devstack cinder-volume[76342]: INFO cinder.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Initiating service 2 cleanup Jul 11 03:44:47 devstack cinder-volume[76342]: INFO cinder.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Service 2 cleanup completed. Jul 11 03:44:47 devstack cinder-volume[76342]: DEBUG cinder.service [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Creating RPC server for service cinder-volume {{(pid=76342) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 03:44:47 devstack cinder-volume[76342]: DEBUG cinder.service [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76342) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 03:44:47 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 11 03:44:47 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:44:47 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:47 devstack sudo[77457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:44:47 devstack sudo[77457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:48 devstack sudo[77457]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:48 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:48 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:48 devstack sudo[77464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:48 devstack sudo[77464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:49 devstack sudo[77464]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.729s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:49 devstack sudo[77467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:44:49 devstack sudo[77467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:49 devstack sudo[77467]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:44:49 devstack sudo[77524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:44:49 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:44:50 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root Jul 11 03:44:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:44:50 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-03add110-0923-49c3-a38f-e8da45b851f4 None None] Driver post RPC initialization completed successfully. Jul 11 03:45:00 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:SELECT=3 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:45:00 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:45:48 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:45:48 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:45:48 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:45:48 devstack sudo[79233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:45:48 devstack sudo[79233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:45:49 devstack sudo[79233]: pam_unix(sudo:session): session closed for user root Jul 11 03:45:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:45:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:45:49 devstack sudo[79263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:45:49 devstack sudo[79263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:45:49 devstack sudo[79263]: pam_unix(sudo:session): session closed for user root Jul 11 03:45:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:45:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:45:49 devstack sudo[79266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:45:49 devstack sudo[79266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:45:50 devstack sudo[79266]: pam_unix(sudo:session): session closed for user root Jul 11 03:45:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:45:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:45:50 devstack sudo[79269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:45:50 devstack sudo[79269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:45:50 devstack sudo[79269]: pam_unix(sudo:session): session closed for user root Jul 11 03:45:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:45:50 devstack cinder-volume[76342]: DEBUG cinder.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Notifying Schedulers of capabilities ... {{(pid=76342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:45:51 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager._thread_info {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:45:51 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] thread count: 6 {{(pid=76342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:45:51 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] thread info: [<_MainThread(MainThread, started 135550420201600)>, , , , , ] {{(pid=76342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:46:48 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:46:48 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:46:48 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:46:48 devstack sudo[82577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:46:48 devstack sudo[82577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:46:49 devstack sudo[82577]: pam_unix(sudo:session): session closed for user root Jul 11 03:46:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:46:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:46:49 devstack sudo[82582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:46:49 devstack sudo[82582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:46:49 devstack sudo[82582]: pam_unix(sudo:session): session closed for user root Jul 11 03:46:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:46:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:46:49 devstack sudo[82602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:46:49 devstack sudo[82602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:46:50 devstack sudo[82602]: pam_unix(sudo:session): session closed for user root Jul 11 03:46:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:46:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:46:50 devstack sudo[82621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:46:50 devstack sudo[82621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:46:50 devstack sudo[82621]: pam_unix(sudo:session): session closed for user root Jul 11 03:46:51 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:46:51 devstack cinder-volume[76342]: DEBUG cinder.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Notifying Schedulers of capabilities ... {{(pid=76342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:46:51 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager._thread_info {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:46:51 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] thread count: 6 {{(pid=76342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:46:51 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] thread info: [<_MainThread(MainThread, started 135550420201600)>, , , , , ] {{(pid=76342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:47:00 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:SELECT=1 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:47:00 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:UPDATE=1 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:47:48 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:47:48 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:47:48 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:47:48 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:47:48 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:47:49 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Jul 11 03:47:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:47:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:47:49 devstack sudo[84640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:47:49 devstack sudo[84640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:47:49 devstack sudo[84640]: pam_unix(sudo:session): session closed for user root Jul 11 03:47:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:47:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:47:49 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:47:49 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:47:50 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Jul 11 03:47:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:47:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:47:50 devstack sudo[84658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:47:50 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:47:50 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root Jul 11 03:47:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:47:50 devstack cinder-volume[76342]: DEBUG cinder.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Notifying Schedulers of capabilities ... {{(pid=76342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:48:48 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:48:48 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Updating volume stats {{(pid=76342) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 11 03:48:48 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:48:48 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 11 03:48:48 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:48:49 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Jul 11 03:48:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:48:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:48:49 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:48:49 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:48:49 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Jul 11 03:48:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:48:49 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:48:49 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 11 03:48:49 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:48:50 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Jul 11 03:48:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:48:50 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:48:50 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 11 03:48:50 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:48:51 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Jul 11 03:48:51 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:48:51 devstack cinder-volume[76342]: DEBUG cinder.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Notifying Schedulers of capabilities ... {{(pid=76342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:48:51 devstack cinder-volume[76342]: DEBUG oslo_service.periodic_task [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] Running periodic task VolumeManager._thread_info {{(pid=76342) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:48:51 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] thread count: 6 {{(pid=76342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:48:51 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-4d3319e2-74b7-4f81-8b6a-c86107d27578 None None] thread info: [<_MainThread(MainThread, started 135550420201600)>, , , , , ] {{(pid=76342) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:49:00 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:SELECT=1 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:49:00 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:UPDATE=1 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:49:10 devstack cinder-volume[76154]: INFO oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Caught SIGTERM, stopping children Jul 11 03:49:10 devstack cinder-volume[76154]: DEBUG oslo_concurrency.lockutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Acquiring lock "singleton_lock" {{(pid=76154) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:49:10 devstack cinder-volume[76154]: DEBUG oslo_concurrency.lockutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Acquired lock "singleton_lock" {{(pid=76154) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:49:10 devstack cinder-volume[76154]: DEBUG oslo_concurrency.lockutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Releasing lock "singleton_lock" {{(pid=76154) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:49:10 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Stop services. {{(pid=76154) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 03:49:10 devstack cinder-volume[76154]: DEBUG oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Killing children. {{(pid=76154) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 03:49:10 devstack cinder-volume[76154]: INFO oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Waiting on 1 children to exit Jul 11 03:49:12 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Acquiring lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:49:12 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Acquired lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:49:12 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Releasing lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:49:12 devstack cinder-volume[76342]: WARNING amqp [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 03:49:12 devstack cinder-volume[76342]: WARNING amqp [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 03:49:12 devstack cinder-volume[76154]: INFO oslo_service.backend._eventlet.service [None req-8c622c8c-868b-4650-9dd9-5f157e7ad934 None None] Child 76342 exited with status 0 Jul 11 03:49:13 devstack cinder-volume[86486]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 03:49:13 devstack cinder-volume[86486]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 03:49:13 devstack cinder-volume[86486]: we strongly recommend against using it for new projects. Jul 11 03:49:13 devstack cinder-volume[86486]: If you are already using Eventlet, we recommend migrating to a different Jul 11 03:49:13 devstack cinder-volume[86486]: framework. For more detail see Jul 11 03:49:13 devstack cinder-volume[86486]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 03:49:13 devstack cinder-volume[86486]: import eventlet # noqa Jul 11 03:49:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:49:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:49:15 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:49:15 devstack cinder-volume[86486]: INFO dbcounter [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Registered counter for database cinder Jul 11 03:49:15 devstack cinder-volume[86486]: DEBUG oslo_db.sqlalchemy.engines [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG dbcounter [-] [86486] Writer thread running {{(pid=86486) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 03:49:16 devstack cinder-volume[86486]: INFO cinder.rpc [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 03:49:16 devstack cinder-volume[86486]: INFO cinder.rpc [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_db.sqlalchemy.engines [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:16 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Determined volume DB was empty at startup. Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG cinder.volume.manager [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86486) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 03:49:16 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 11 03:49:16 devstack cinder-volume[86486]: WARNING stevedore.named [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 03:49:16 devstack cinder-volume[86486]: WARNING castellan.key_manager [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:49:16 devstack cinder-volume[86486]: WARNING cinder.keymgr.conf_key_mgr [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:49:16 devstack cinder-volume[86486]: INFO cinder.volume.manager [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_db.sqlalchemy.engines [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86486) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:16 devstack cinder-volume[86486]: INFO oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Starting 1 workers Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Started child 86704 {{(pid=86486) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Full set of CONF: {{(pid=86486) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] ******************************************************************************** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Configuration options gathered from: {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] ================================================================================ {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] allow_availability_zone_fallback = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] allow_compression_on_image_upload = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] allowed_direct_url_schemes = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86704]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] api_rate_limit = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] auth_strategy = keystone {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_availability_zone = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_host = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_stats_polling_interval = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backup_api_class = cinder.backup.api.API {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backup_name_template = backup-%s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backup_use_same_host = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backup_use_temp_snapshot = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] chap_password = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] chap_username = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_internal_tenant_project_id = eb8c6eb60ad6446e93c430472232ebde {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_internal_tenant_user_id = e4959b0b96054419ba08570ae946d0bc {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cluster = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] compression_format = gzip {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] config_dir = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] config_source = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] control_exchange = openstack {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] debug = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] default_availability_zone = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] default_group_type = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] default_volume_type = QuobyteHD {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] disk_geometry = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] driver_client_cert = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] driver_client_cert_key = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] driver_data_namespace = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] driver_ssl_cert_path = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] driver_ssl_cert_verify = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] driver_use_ssl = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] enable_new_services = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] enable_unsupported_driver = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] enforce_multipath_for_image_xfer = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] filter_function = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_api_insecure = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_api_servers = ['http://192.168.122.161/image'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_api_ssl_compression = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_ca_certificates_file = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_num_retries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance_request_timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] goodness_function = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] graceful_shutdown_timeout = 5 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] group_api_class = cinder.group.api.API {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] host = devstack {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_compress_on_upload = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_conversion_address_space_limit = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_conversion_cpu_limit = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_conversion_disable = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_upload_use_cinder_backend = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_upload_use_internal_tenant = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_volume_cache_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_volume_cache_max_count = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] init_host_max_objects_retrieval = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] instance_format = [instance: %(uuid)s] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] iscsi_target_flags = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] iscsi_write_cache = on {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] iser_helper = tgtadm {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] iser_ip_address = 192.168.122.161 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] iser_port = 3260 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_color = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_config_append = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_dir = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_file = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_options = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_rotate_interval = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_rotate_interval_type = days {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] log_rotation_type = none {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] max_age = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] max_logfile_count = 30 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] max_logfile_size_mb = 200 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] max_over_subscription_ratio = 20.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] message_reap_interval = 86400 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] message_ttl = 2592000 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86704]: INFO cinder.volume.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.remotefs [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86704) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] monkey_patch = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] monkey_patch_modules = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] my_ip = 192.168.122.161 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] no_snapshot_gb_quota = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] num_iser_scan_tries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] num_shell_tries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] num_volume_device_scan_tries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] nvmeof_conn_info_version = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] nvmet_ns_id = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] nvmet_port_id = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_max_limit = 1000 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_volume_ext_list = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_volume_listen_port = 8776 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_volume_use_ssl = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] osapi_volume_workers = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] per_volume_size_limit = -1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] periodic_fuzzy_delay = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] periodic_interval = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] public_endpoint = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] publish_errors = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_backup_gigabytes = 1000 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_backups = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_gigabytes = 1000 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_groups = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_snapshots = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] quota_volumes = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] rate_limit_burst = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] rate_limit_except_level = CRITICAL {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] rate_limit_interval = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] reinit_driver_count = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] replication_device = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] report_discard_supported = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] report_interval = 120 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] reservation_clean_interval = 86400 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] reservation_expire = 86400 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] reserved_image_namespaces = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] reserved_percentage = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] rpc_response_timeout = 120 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] run_external_periodic_tasks = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] scst_target_driver = iscsi {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] scst_target_iqn_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_down_time = 720 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] shell_completion = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] snapshot_name_template = snapshot-%s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] split_loggers = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] state_path = /opt/stack/data/cinder {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] storage_availability_zone = nova {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] storage_protocol = iSCSI {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] syslog_log_facility = LOG_USER {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] target_helper = lioadm {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] target_ip_address = 192.168.122.161 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] target_port = 3260 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] target_protocol = iscsi {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] target_secondary_ip_addresses = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] trace_flags = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] transport_url = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] until_refresh = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_chap_auth = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_default_quota_class = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_journal = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_json = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_multipath_for_image_xfer = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_stderr = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] use_syslog = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] verify_glance_signatures = enabled {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_api_class = cinder.volume.api.API {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_backend_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_clear = zero {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_clear_ionice = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_clear_size = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_copy_bps_limit = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_dd_blocksize = 1M {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_name_template = volume-%s {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_service_inithost_offload = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volume_usage_audit_period = month {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] zoning_mode = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.auth_section = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.auth_type = password {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.auth_version = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.cache = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.insecure = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.interface = public {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_password = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcache_username = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.region_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.service_type = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.161/identity {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.backend = dogpile.cache.null {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.backend_argument = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.backend_expiration_time = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.config_prefix = cache.oslo {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.debug_cache_backend = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.enable_retry_client = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.enable_socket_keepalive = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.expiration_time = 600 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_dead_retry = 300 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_sasl_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.password = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.proxies = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.redis_db = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.redis_server = localhost:6379 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.retry_attempts = 2 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.retry_delay = 0.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.socket_keepalive_count = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.socket_keepalive_idle = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.socket_keepalive_interval = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.socket_timeout = 1.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.tls_allowed_ciphers = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86704) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 03:49:16 devstack cinder-volume[86704]: WARNING cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 03:49:16 devstack cinder-volume[86704]: WARNING cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Running cmd (subprocess): mount.quobyte {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.tls_cafile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.tls_certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.tls_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.tls_keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cache.username = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] coordination.backend_url = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.asyncio_connection = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.asyncio_slave_connection = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.backend = sqlalchemy {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.connection = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.connection_debug = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.connection_parameters = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.connection_recycle_time = 3600 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.connection_trace = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.db_inc_retry_interval = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.db_max_retries = 20 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.db_max_retry_interval = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.db_retry_interval = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.max_overflow = 50 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.max_pool_size = 5 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.max_retries = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.pool_timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.retry_interval = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.slave_connection = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.sqlite_synchronous = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.synchronous_reader = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] database.use_db_reconnect = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.connection_string = messaging:// {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.es_doc_type = notification {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.es_scroll_size = 10000 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.es_scroll_time = 2m {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.filter_error_trace = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.hmac_keys = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.sentinel_service_name = mymaster {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.socket_timeout = 0.1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.trace_requests = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler.trace_sqlalchemy = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler_jaeger.process_tags = {} {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] profiler_otlp.service_name_prefix = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.enforce_scope = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.policy_default_rule = default {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.group = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.helper_command = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] privsep_osbrick.user = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.group = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.helper_command = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] cinder_sys_admin.user = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.auth_section = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.auth_type = password {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.cafile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.collect_timing = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.insecure = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.send_service_user_token = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.split_loggers = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] service_user.timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.auth_section = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.auth_type = password {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.collect_timing = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.insecure = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.region_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.split_loggers = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] glance.timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.backend_availability_zone = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.chap_password = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.chap_username = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.disk_geometry = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.driver_client_cert = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.driver_data_namespace = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.driver_use_ssl = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.extra_capabilities = {} {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.filter_function = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.goodness_function = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.iscsi_target_flags = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.iser_port = 3260 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_host = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_login = admin {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_mount_options = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_password = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_private_key = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_share_path = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.replication_device = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.report_discard_supported = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.target_helper = tgtadm {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.target_port = 3260 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.target_protocol = iscsi {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.trace_flags = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.use_chap_auth = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_backend_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_clear = zero {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_reports.file_event_handler = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_reports.log_dir = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.backend_host = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.chap_password = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.chap_username = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.disk_geometry = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.driver_client_cert = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.extra_capabilities = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.filter_function = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.goodness_function = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.iser_helper = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.iser_ip_address = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.iser_port = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_host = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_login = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_mount_options = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_password = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_private_key = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_share_path = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.num_shell_tries = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.replication_device = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.report_discard_supported = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.reserved_percentage = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.scst_target_driver = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.storage_protocol = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.target_helper = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.target_ip_address = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.target_port = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.target_prefix = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack quobyte-client[86705]: Reading configuration file: /etc/quobyte/client.cfg Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.target_protocol = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.trace_flags = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.use_chap_auth = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack quobyte-client[86705]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_clear = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_clear_size = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] QuobyteHD.volumes_dir = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] CMD "mount.quobyte" returned: 1 in 0.169s {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=86704) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86704]: INFO cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 ... Jul 11 03:49:16 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 -c /etc/quobyte/client-cinder.cfg {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_notifications.driver = [] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] key_manager.fixed_key = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.barbican_api_version = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.barbican_endpoint = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.barbican_endpoint_type = public {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.barbican_region_name = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.cafile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.collect_timing = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.insecure = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.number_of_retries = 60 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.retry_delay = 1 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.send_service_user_token = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.split_loggers = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.verify_ssl = True {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican.verify_ssl_path = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.auth_section = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.auth_type = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.cafile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.certfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.collect_timing = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.insecure = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.keyfile = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.split_loggers = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] barbican_service_user.timeout = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.approle_role_id = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.approle_secret_id = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.kv_mountpoint = secret {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.kv_path = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.kv_version = 2 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.namespace = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.root_token_id = **** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.ssl_ca_crt_file = None {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.timeout = 60.0 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.use_ssl = False {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:16 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] ******************************************************************************** {{(pid=86486) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 03:49:16 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 -c /etc/quobyte/client-cinder.cfg Jul 11 03:49:16 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:17 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:17 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.784s {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:17 devstack cinder-volume[86704]: INFO cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 succeeded Jul 11 03:49:17 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=86704) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:17 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.800s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:17 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:17 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:17 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:18 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.624s {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:18 devstack cinder-volume[86704]: INFO cinder.volume.driver [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG cinder.volume.driver [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86704) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG oslo_db.sqlalchemy.engines [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86704) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG dbcounter [-] [86704] Writer thread running {{(pid=86704) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG cinder.db.api [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Building query based on filter {{(pid=86704) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG cinder.image.image_utils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86704) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1300}} Jul 11 03:49:18 devstack cinder-volume[86704]: INFO cinder.keymgr.migration [None req-ed244cfa-932c-4db5-90ad-e4fa224899dc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=86704) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=86704) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:18 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:18 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:18 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:19 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.626s {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG cinder.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Notifying Schedulers of capabilities ... {{(pid=86704) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:49:19 devstack cinder-volume[86704]: INFO cinder.volume.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Driver initialization completed successfully. Jul 11 03:49:19 devstack cinder-volume[86704]: INFO cinder.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Initiating service 3 cleanup Jul 11 03:49:19 devstack cinder-volume[86704]: INFO cinder.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Service 3 cleanup completed. Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG cinder.service [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Creating RPC server for service cinder-volume {{(pid=86704) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG cinder.service [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86704) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 03:49:19 devstack cinder-volume[86704]: INFO cinder.volume.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=86704) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=86704) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:19 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:19 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:19 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:19 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.649s {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:19 devstack cinder-volume[86704]: INFO cinder.volume.manager [None req-36b12cb8-95c9-46b0-9e08-0ea070346c89 None None] Driver post RPC initialization completed successfully. Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=86704) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG cinder.volume.drivers.quobyte [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=86704) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86704) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:24 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:24 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:24 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG oslo_concurrency.processutils [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.683s {{(pid=86704) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:24 devstack cinder-volume[86704]: DEBUG cinder.manager [None req-5f34bb69-1516-41c4-be85-1164a510e4f8 None None] Notifying Schedulers of capabilities ... {{(pid=86704) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:49:25 devstack cinder-volume[86486]: INFO oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Caught SIGTERM, stopping children Jul 11 03:49:25 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Acquiring lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:49:25 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Acquired lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:49:25 devstack cinder-volume[86486]: DEBUG oslo_concurrency.lockutils [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Releasing lock "singleton_lock" {{(pid=86486) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:49:25 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Stop services. {{(pid=86486) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 11 03:49:25 devstack cinder-volume[86486]: DEBUG oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Killing children. {{(pid=86486) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 11 03:49:25 devstack cinder-volume[86486]: INFO oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Waiting on 1 children to exit Jul 11 03:49:27 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Acquiring lock "singleton_lock" {{(pid=86704) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:49:27 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Acquired lock "singleton_lock" {{(pid=86704) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:49:27 devstack cinder-volume[86704]: DEBUG oslo_concurrency.lockutils [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Releasing lock "singleton_lock" {{(pid=86704) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:49:27 devstack cinder-volume[86704]: WARNING amqp [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 03:49:27 devstack cinder-volume[86704]: WARNING amqp [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 11 03:49:27 devstack cinder-volume[86486]: INFO oslo_service.backend._eventlet.service [None req-816b159e-c681-4a89-95a3-1af8f4cd8ae3 None None] Child 86704 exited with status 0 Jul 11 03:49:28 devstack cinder-volume[87107]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 11 03:49:28 devstack cinder-volume[87107]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 03:49:28 devstack cinder-volume[87107]: we strongly recommend against using it for new projects. Jul 11 03:49:28 devstack cinder-volume[87107]: If you are already using Eventlet, we recommend migrating to a different Jul 11 03:49:28 devstack cinder-volume[87107]: framework. For more detail see Jul 11 03:49:28 devstack cinder-volume[87107]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 03:49:28 devstack cinder-volume[87107]: import eventlet # noqa Jul 11 03:49:31 devstack cinder-volume[87107]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87107) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 11 03:49:31 devstack cinder-volume[87107]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87107) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 11 03:49:31 devstack cinder-volume[87107]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87107) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 11 03:49:32 devstack cinder-volume[87107]: INFO dbcounter [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Registered counter for database cinder Jul 11 03:49:32 devstack cinder-volume[87107]: DEBUG oslo_db.sqlalchemy.engines [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87107) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG dbcounter [-] [87107] Writer thread running {{(pid=87107) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 03:49:33 devstack cinder-volume[87107]: INFO cinder.rpc [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 11 03:49:33 devstack cinder-volume[87107]: INFO cinder.rpc [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_db.sqlalchemy.engines [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87107) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:33 devstack cinder-volume[87107]: INFO cinder.volume.manager [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Determined volume DB was empty at startup. Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG cinder.volume.manager [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87107) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 11 03:49:33 devstack cinder-volume[87107]: WARNING stevedore.named [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 11 03:49:33 devstack cinder-volume[87107]: WARNING castellan.key_manager [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:49:33 devstack cinder-volume[87107]: WARNING cinder.keymgr.conf_key_mgr [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 11 03:49:33 devstack cinder-volume[87107]: INFO cinder.volume.manager [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_db.sqlalchemy.engines [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87107) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:33 devstack cinder-volume[87107]: INFO oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Starting 1 workers Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Started child 87437 {{(pid=87107) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Full set of CONF: {{(pid=87107) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] ******************************************************************************** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] Configuration options gathered from: {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] ================================================================================ {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] allow_availability_zone_fallback = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] allow_compression_on_image_upload = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] allowed_direct_url_schemes = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] api_rate_limit = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] auth_strategy = keystone {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_availability_zone = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_host = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_stats_polling_interval = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backup_api_class = cinder.backup.api.API {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87437]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backup_name_template = backup-%s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backup_use_same_host = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backup_use_temp_snapshot = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] chap_password = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] chap_username = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_internal_tenant_project_id = eb8c6eb60ad6446e93c430472232ebde {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_internal_tenant_user_id = e4959b0b96054419ba08570ae946d0bc {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cluster = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] compression_format = gzip {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] compute_api_class = cinder.compute.nova.API {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] config_dir = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] config_source = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] control_exchange = openstack {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] debug = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] default_availability_zone = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] default_group_type = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] default_volume_type = QuobyteHD {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] disk_geometry = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] driver_client_cert = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] driver_client_cert_key = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] driver_data_namespace = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] driver_ssl_cert_path = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] driver_ssl_cert_verify = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] driver_use_ssl = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] enable_new_services = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] enable_unsupported_driver = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] enabled_backends = ['QuobyteHD'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] enforce_multipath_for_image_xfer = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] filter_function = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_api_insecure = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_api_servers = ['http://192.168.122.161/image'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_api_ssl_compression = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_ca_certificates_file = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_catalog_info = image:glance:publicURL {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_num_retries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance_request_timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] goodness_function = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] graceful_shutdown_timeout = 5 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] group_api_class = cinder.group.api.API {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] host = devstack {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_compress_on_upload = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_conversion_address_space_limit = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_conversion_cpu_limit = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_conversion_disable = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_upload_use_cinder_backend = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_upload_use_internal_tenant = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_volume_cache_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_volume_cache_max_count = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] image_volume_cache_max_size_gb = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] init_host_max_objects_retrieval = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] instance_format = [instance: %(uuid)s] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] iscsi_target_flags = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] iscsi_write_cache = on {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] iser_helper = tgtadm {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] iser_ip_address = 192.168.122.161 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] iser_port = 3260 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_color = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_config_append = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_dir = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_file = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_options = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_rotate_interval = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_rotate_interval_type = days {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] log_rotation_type = none {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] max_age = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] max_logfile_count = 30 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] max_logfile_size_mb = 200 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] max_over_subscription_ratio = 20.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] message_reap_interval = 86400 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] message_ttl = 2592000 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] migration_create_volume_timeout_secs = 300 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] monkey_patch = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] monkey_patch_modules = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] my_ip = 192.168.122.161 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] no_snapshot_gb_quota = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] num_iser_scan_tries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] num_shell_tries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] num_volume_device_scan_tries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] nvmeof_conn_info_version = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] nvmet_ns_id = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] nvmet_port_id = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_max_limit = 1000 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_volume_ext_list = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_volume_listen_port = 8776 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_volume_use_ssl = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] osapi_volume_workers = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] per_volume_size_limit = -1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] periodic_fuzzy_delay = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] periodic_interval = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] public_endpoint = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] publish_errors = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_backup_gigabytes = 1000 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_backups = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_gigabytes = 1000 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_groups = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_snapshots = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] quota_volumes = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] rate_limit_burst = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] rate_limit_except_level = CRITICAL {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] rate_limit_interval = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] reinit_driver_count = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] replication_device = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] report_discard_supported = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] report_interval = 120 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] reservation_clean_interval = 86400 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] reservation_expire = 86400 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] reserved_image_namespaces = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] reserved_percentage = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] rpc_response_timeout = 120 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] run_external_periodic_tasks = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] scst_target_driver = iscsi {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] scst_target_iqn_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_down_time = 720 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] shell_completion = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] snapshot_name_template = snapshot-%s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] split_loggers = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] state_path = /opt/stack/data/cinder {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] storage_availability_zone = nova {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] storage_protocol = iSCSI {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] syslog_log_facility = LOG_USER {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] target_helper = lioadm {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] target_ip_address = 192.168.122.161 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] target_port = 3260 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] target_protocol = iscsi {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] target_secondary_ip_addresses = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] trace_flags = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] transport_url = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] until_refresh = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_chap_auth = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87437) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_default_quota_class = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_journal = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_json = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_multipath_for_image_xfer = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_stderr = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] use_syslog = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] verify_glance_signatures = enabled {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_api_class = cinder.volume.api.API {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_backend_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_clear = zero {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_clear_ionice = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_clear_size = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_copy_bps_limit = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_dd_blocksize = 1M {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_name_template = volume-%s {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_service_inithost_offload = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volume_usage_audit_period = month {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] zoning_mode = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_concurrency.disable_process_locking = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.auth_section = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.auth_type = password {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.auth_version = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.cache = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.include_service_catalog = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.insecure = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.interface = public {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_password = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcache_username = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.region_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.service_type = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.161/identity {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.backend = dogpile.cache.null {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.backend_argument = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.backend_expiration_time = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.config_prefix = cache.oslo {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.debug_cache_backend = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.enable_retry_client = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.enable_socket_keepalive = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.expiration_time = 600 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.hashclient_retry_attempts = 2 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_dead_retry = 300 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_pool_maxsize = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_sasl_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.password = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.proxies = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.redis_db = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.redis_server = localhost:6379 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.retry_attempts = 2 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.retry_delay = 0.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.socket_keepalive_count = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.socket_keepalive_idle = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.socket_keepalive_interval = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.socket_timeout = 1.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.tls_allowed_ciphers = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.tls_cafile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.tls_certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.tls_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.tls_keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cache.username = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] coordination.backend_url = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.asyncio_connection = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.asyncio_slave_connection = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.backend = sqlalchemy {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.connection = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.connection_debug = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.connection_parameters = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.connection_recycle_time = 3600 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.connection_trace = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.db_inc_retry_interval = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.db_max_retries = 20 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.db_max_retry_interval = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.db_retry_interval = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.max_overflow = 50 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.max_pool_size = 5 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.max_retries = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.mysql_wsrep_sync_wait = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.pool_timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.retry_interval = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.slave_connection = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.sqlite_synchronous = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.synchronous_reader = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] database.use_db_reconnect = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.connection_string = messaging:// {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.es_doc_type = notification {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.es_scroll_size = 10000 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.es_scroll_time = 2m {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.filter_error_trace = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.hmac_keys = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.sentinel_service_name = mymaster {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.socket_timeout = 0.1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.trace_requests = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler.trace_sqlalchemy = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler_jaeger.process_tags = {} {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler_jaeger.service_name_prefix = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] profiler_otlp.service_name_prefix = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.enforce_new_defaults = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.enforce_scope = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.policy_default_rule = default {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.policy_file = policy.yaml {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.group = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.helper_command = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] privsep_osbrick.user = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.group = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.helper_command = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] cinder_sys_admin.user = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.auth_section = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.auth_type = password {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.cafile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.collect_timing = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.insecure = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.send_service_user_token = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.split_loggers = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] service_user.timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.auth_section = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.auth_type = password {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.collect_timing = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.insecure = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.region_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.split_loggers = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] glance.timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.backend_availability_zone = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.chap_password = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.chap_username = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87437) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 11 03:49:33 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.disk_geometry = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.driver_client_cert = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.driver_client_cert_key = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.driver_data_namespace = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.driver_use_ssl = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.extra_capabilities = {} {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.filter_function = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Running cmd (subprocess): mount.quobyte {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.goodness_function = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.iscsi_target_flags = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.iscsi_write_cache = on {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.iser_helper = tgtadm {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.iser_ip_address = 192.168.122.161 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.iser_port = 3260 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_host = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_login = admin {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_mount_options = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_password = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_private_key = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_share_path = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.num_shell_tries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.quobyte_volume_url = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.replication_device = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.report_discard_supported = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.reserved_percentage = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.target_helper = tgtadm {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.target_ip_address = 192.168.122.161 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.target_port = 3260 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.target_protocol = iscsi {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.trace_flags = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.unique_fqdn_network = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.use_chap_auth = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_backend_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_clear = zero {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_clear_ionice = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_clear_size = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_reports.file_event_handler = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_reports.log_dir = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.backend_availability_zone = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.backend_host = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.chap_password = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.chap_username = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.chiscsi_conf = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.disk_geometry = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.driver_client_cert = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.driver_data_namespace = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.driver_use_ssl = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.extra_capabilities = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.filter_function = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.goodness_function = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.iser_helper = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.iser_ip_address = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.iser_port = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.iser_target_prefix = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_host = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_login = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_mount_options = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_password = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_private_key = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_share_path = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_ssh_port = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.num_shell_tries = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.nvmet_port_id = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.replication_device = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.report_discard_supported = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.reserved_percentage = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.scst_target_driver = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.storage_protocol = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.target_helper = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.target_ip_address = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.target_port = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.target_prefix = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.target_protocol = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.trace_flags = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.use_chap_auth = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_clear = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_clear_size = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] QuobyteHD.volumes_dir = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:33 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_notifications.driver = [] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_notifications.retry = -1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] key_manager.fixed_key = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.barbican_api_version = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.barbican_endpoint = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.barbican_endpoint_type = public {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.barbican_region_name = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.cafile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.collect_timing = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.insecure = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.number_of_retries = 60 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.retry_delay = 1 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.send_service_user_token = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.split_loggers = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.verify_ssl = True {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican.verify_ssl_path = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.auth_section = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.auth_type = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.cafile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.certfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.collect_timing = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.insecure = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.keyfile = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.split_loggers = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] barbican_service_user.timeout = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.approle_role_id = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.approle_secret_id = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.kv_mountpoint = secret {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.kv_path = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.kv_version = 2 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.namespace = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.root_token_id = **** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.ssl_ca_crt_file = None {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.timeout = 60.0 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.use_ssl = False {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 11 03:49:33 devstack cinder-volume[87107]: DEBUG oslo_service.backend._eventlet.service [None req-80b86bfb-d8f6-4ea7-acbf-7bcc2399294d None None] ******************************************************************************** {{(pid=87107) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.774s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:34 devstack cinder-volume[87437]: INFO cinder.volume.driver [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Driver hasn't implemented _init_vendor_properties() Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG cinder.volume.driver [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87437) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 11 03:49:34 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG oslo_db.sqlalchemy.engines [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writer thread running {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG cinder.db.api [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Building query based on filter {{(pid=87437) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87437) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1300}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:34 devstack cinder-volume[87437]: INFO cinder.keymgr.migration [None req-b45ecb1e-9c94-43e3-894b-53b335ef401e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 11 03:49:34 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:34 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:35 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:49:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Driver initialization completed successfully. Jul 11 03:49:35 devstack cinder-volume[87437]: INFO cinder.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Initiating service 3 cleanup Jul 11 03:49:35 devstack cinder-volume[87437]: INFO cinder.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Service 3 cleanup completed. Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG cinder.service [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Creating RPC server for service cinder-volume {{(pid=87437) start /opt/stack/cinder/cinder/service.py:231}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG cinder.service [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87437) start /opt/stack/cinder/cinder/service.py:237}} Jul 11 03:49:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:49:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:49:35 devstack sudo[87488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:49:35 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:49:36 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root Jul 11 03:49:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:49:36 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0e423a5c-aa2c-427e-9610-36b7ae918740 None None] Driver post RPC initialization completed successfully. Jul 11 03:49:43 devstack cinder-volume[87107]: DEBUG dbcounter [-] [87107] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87107) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:49:45 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:49:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=3 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:50:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:50:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 6 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:50:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:50:34 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:50:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Flow 'volume_create_manager' (558181e9-9d44-446d-904f-39c7327f9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:50:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd7c1dd-90a6-40ac-a659-03923c1b5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd7c1dd-90a6-40ac-a659-03923c1b5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1323226336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5215ec71-911e-4a4c-ac34-f2024ccfdd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453079d0d6c244f68eaf9bbc522c266b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:50:35Z,use_quota=True,user_id='c01e33e57e8b4ca4a748957c394665d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647fd3fb-9405-4e37-825f-3fed2caec9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647fd3fb-9405-4e37-825f-3fed2caec9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7355378-4f92-4543-811c-a6bc19aef4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7355378-4f92-4543-811c-a6bc19aef4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5215ec71-911e-4a4c-ac34-f2024ccfdd1a', 'volume_name': 'volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fb2ef9-d9a2-46a2-8a96-0a9441eb78b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fb2ef9-d9a2-46a2-8a96-0a9441eb78b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60592d34-b473-449c-9f96-c54484341bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Volume 5215ec71-911e-4a4c-ac34-f2024ccfdd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a', 'volume_size': 1} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1323226336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5215ec71-911e-4a4c-ac34-f2024ccfdd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='453079d0d6c244f68eaf9bbc522c266b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:50:35Z,use_quota=True,user_id='c01e33e57e8b4ca4a748957c394665d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Creating volume 5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:50:35 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:50:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:35 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a 1073741824 Jul 11 03:50:35 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:37 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a 1073741824" returned: 0 in 1.804s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:37 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a Jul 11 03:50:37 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:38 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" returned: 0 in 1.668s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] <== create_volume: return (3630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.645s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60592d34-b473-449c-9f96-c54484341bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2718abf7-582a-4646-90c9-5a5c15abf6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:38 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Volume volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a (5215ec71-911e-4a4c-ac34-f2024ccfdd1a): created successfully Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2718abf7-582a-4646-90c9-5a5c15abf6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Flow 'volume_create_manager' (558181e9-9d44-446d-904f-39c7327f9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:50:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-6c68e71d-7f99-4229-9584-74ac112d0106 req-34991625-e230-4941-8953-554fc4cfb841 tempest-VolumesSnapshotsTestJSON-1333934189 None] Created volume successfully. Jul 11 03:50:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Creating offline snapshot ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 of volume 5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:50:40 devstack cinder-volume[87437]: INFO oslo.privsep.daemon [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfi2c1fab/privsep.sock'] Jul 11 03:50:40 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfi2c1fab/privsep.sock Jul 11 03:50:40 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 03:50:41 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: Jul 11 03:50:42 devstack cinder-volume[87437]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 11 03:50:43 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:43 devstack cinder-volume[87437]: INFO oslo.privsep.daemon [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Spawned new privsep daemon via rootwrap Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Accepted privsep connection to /tmp/tmpfi2c1fab/privsep.sock {{(pid=87437) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 11 03:50:43 devstack cinder-volume[87437]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 11 03:50:43 devstack cinder-volume[87437]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 11 03:50:43 devstack cinder-volume[87437]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 11 03:50:43 devstack cinder-volume[87437]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88314 Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4fc2b-9dd6-4a73-9f70-6e0d9cd04111]: (2,) {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4625459-ebb4-40c6-8e46-ca21c5f47294]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:43 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a Jul 11 03:50:43 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Flow 'volume_create_manager' (42b37c0d-fb1c-4169-a047-ca9796bf9054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:50:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3917dc98-f197-4fb1-8b7c-2a38ae3e685d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3917dc98-f197-4fb1-8b7c-2a38ae3e685d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1380956427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a56aa1f-a84c-44ea-b8f3-d9356ce7769b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660061c57b084f6f9c8a16617e8086fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:50:44Z,use_quota=True,user_id='7a6fcc2af37b4136aacaf4aa511ad339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68527061-5f60-49d3-87d7-bc94551050fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68527061-5f60-49d3-87d7-bc94551050fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6caf81-759b-41b6-b17f-a8bdad9992a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6caf81-759b-41b6-b17f-a8bdad9992a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a56aa1f-a84c-44ea-b8f3-d9356ce7769b', 'volume_name': 'volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6225161-2660-4666-a254-6950619660a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6225161-2660-4666-a254-6950619660a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb976c8-a85e-4456-818a-55a0fffe4fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:44 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Volume 1a56aa1f-a84c-44ea-b8f3-d9356ce7769b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b', 'volume_size': 1} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:44 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" returned: 0 in 1.001s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:44 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 1G Jul 11 03:50:44 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:45 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 1G" returned: 0 in 1.236s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:45 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 Jul 11 03:50:45 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:46 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" returned: 0 in 0.832s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:46 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 is being set with open permissions: ugo+rw Jul 11 03:50:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:46 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 Jul 11 03:50:46 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:47 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" returned: 0 in 1.045s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:47 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info Jul 11 03:50:47 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:48 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info" returned: 0 in 0.794s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:48 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info is being set with open permissions: ugo+rw Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:48 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info Jul 11 03:50:48 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:48 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.info" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.235s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.864s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1380956427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a56aa1f-a84c-44ea-b8f3-d9356ce7769b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660061c57b084f6f9c8a16617e8086fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:50:44Z,use_quota=True,user_id='7a6fcc2af37b4136aacaf4aa511ad339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Creating volume 1a56aa1f-a84c-44ea-b8f3-d9356ce7769b {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:50:48 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:50:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:49 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b 1073741824 Jul 11 03:50:49 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-1c217f33-5904-45c7-b83b-cd6beb75e348 req-13e159b4-c86d-4240-bf42-2098b4023267 tempest-VolumesSnapshotsTestJSON-1333934189 None] Create snapshot completed successfully Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "cinder-ec29e45b-c294-4dd7-9edb-e25f6d7f7af7-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-ec29e45b-c294-4dd7-9edb-e25f6d7f7af7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "cinder-quobyte-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-quobyte-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "cinder-quobyte-ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-quobyte-ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Deleting offline snapshot ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 of volume 5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] snapshot_file for this snap is: volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecaa245-e27e-468c-89d5-9dde590ec065]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:50:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:49 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 Jul 11 03:50:49 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:50 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b 1073741824" returned: 0 in 1.108s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:50 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b Jul 11 03:50:50 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:50 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" returned: 0 in 1.121s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f1f90-3cd8-420c-849c-adc2758d130a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:50 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a Jul 11 03:50:50 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:50 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b" returned: 0 in 0.801s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb976c8-a85e-4456-818a-55a0fffe4fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff07540f-2068-4fda-95a5-55479f46b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:50:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Volume volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b (1a56aa1f-a84c-44ea-b8f3-d9356ce7769b): created successfully Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff07540f-2068-4fda-95a5-55479f46b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:50:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Flow 'volume_create_manager' (42b37c0d-fb1c-4169-a047-ca9796bf9054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:50:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-473184ad-a35f-4d73-a9cf-11b98a421539 tempest-VolumesAdminNegativeTest-425616936 None] Created volume successfully. Jul 11 03:50:51 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" returned: 0 in 1.036s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:51 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 Jul 11 03:50:51 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Acquiring lock "cinder-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Lock "cinder-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Acquiring lock "cinder-quobyte-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Lock "cinder-quobyte-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ced64c-dfff-4a6f-9bcf-dc74eec604b2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:52 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b Jul 11 03:50:52 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:52 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" returned: 0 in 0.912s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:52 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7 Jul 11 03:50:52 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:53 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b" returned: 0 in 0.863s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:53 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b Jul 11 03:50:53 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:53 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a.ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" returned: 0 in 0.754s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-quobyte-ec29e45b-c294-4dd7-9edb-e25f6d7f7af7" released by "_delete_snapshot" :: held 3.964s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-quobyte-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" released by "delete_snapshot" :: held 4.005s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:50:53 devstack cinder-volume[87437]: WARNING cinder.quota [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:50:53 devstack cinder-volume[87437]: WARNING cinder.quota [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.quota [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Created reservations ['9e4c94d1-0013-4129-9164-59963f423d4d', '2811c4ee-401d-426b-b175-290595786aea', 'ce384aa5-8541-4fce-831c-f6c9a20e82fd', '0b83252c-9154-46de-95ab-8ae230472695'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:50:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Delete snapshot completed successfully. Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ea66059a-6eb3-4904-8783-408584528234 req-4bdf1a0d-5280-4aa8-a6d9-58a81da0fc74 tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-ec29e45b-c294-4dd7-9edb-e25f6d7f7af7-delete_snapshot" released by "delete_snapshot" :: held 4.261s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "cinder-5215ec71-911e-4a4c-ac34-f2024ccfdd1a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-5215ec71-911e-4a4c-ac34-f2024ccfdd1a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "cinder-quobyte-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-quobyte-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:50:54 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b" returned: 0 in 0.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee87e448-6710-46ac-a679-1229a5825c31]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Lock "cinder-quobyte-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b" released by "delete_volume" :: held 1.765s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:54 devstack cinder-volume[87437]: WARNING cinder.quota [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Created reservations ['f10f6990-c522-4d66-8172-5618ff026a81', 'b8839572-505b-41b2-b858-db5b13443011', '796f3414-a091-44e4-ac11-5950eb4f4621', 'd6477a35-3cf1-4513-9dd8-574bd6dd98d6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:50:54 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a Jul 11 03:50:54 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:54 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:50:54 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:55 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.865s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:55 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:50:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Deleted volume successfully. Jul 11 03:50:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bd4b825-0c49-450e-bd6e-fce89c02cbb8 tempest-VolumesAdminNegativeTest-425616936 None] Lock "cinder-1a56aa1f-a84c-44ea-b8f3-d9356ce7769b-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:50:55 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" returned: 0 in 1.286s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:55 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a Jul 11 03:50:55 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:56 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" returned: 0 in 0.739s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-quobyte-5215ec71-911e-4a4c-ac34-f2024ccfdd1a" released by "delete_volume" :: held 2.115s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG cinder.quota [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Created reservations ['8cb37444-a1aa-44f3-81f1-4d354bd95f71', 'b2074d68-34eb-4d16-994d-36d57ec77800', '6641daed-2b5f-4ec0-9c6f-e87d939947f2', '7458913c-d6ce-4f2c-9e64-3fa3d909074e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:50:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:50:56 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:50:56 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:50:57 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Jul 11 03:50:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.083s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:50:57 devstack cinder-volume[87437]: DEBUG cinder.manager [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:50:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Deleted volume successfully. Jul 11 03:50:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-f795705e-2685-48e0-ad48-ec9663ea2081 req-8ca3d1d2-c5b9-4e64-9497-92e3aa0108cc tempest-VolumesSnapshotsTestJSON-1333934189 None] Lock "cinder-5215ec71-911e-4a4c-ac34-f2024ccfdd1a-delete_volume" released by "delete_volume" :: held 3.453s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Flow 'volume_create_manager' (57145b49-87f8-41b6-b6d4-6779c8a61e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4136aff3-4897-47d5-b354-e90f73e63f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4136aff3-4897-47d5-b354-e90f73e63f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-140494631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1c8b01-c681-40c6-8839-fb8fc6f654b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfc40d7aba24c8e9bb377e9d87e63eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:01Z,use_quota=True,user_id='17fa65e5e08b40ae9679986676924be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ef2497-65b3-481b-8441-7162786c238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ef2497-65b3-481b-8441-7162786c238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a26022-a4a1-4db5-8a84-e19cb20e88fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a26022-a4a1-4db5-8a84-e19cb20e88fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1c8b01-c681-40c6-8839-fb8fc6f654b1', 'volume_name': 'volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89880aa3-c462-42b0-8234-2aa273c668c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89880aa3-c462-42b0-8234-2aa273c668c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72583a59-1791-4587-8a94-0ed6efd1684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Volume 0a1c8b01-c681-40c6-8839-fb8fc6f654b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1', 'volume_size': 1} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-140494631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1c8b01-c681-40c6-8839-fb8fc6f654b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfc40d7aba24c8e9bb377e9d87e63eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:01Z,use_quota=True,user_id='17fa65e5e08b40ae9679986676924be2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Creating volume 0a1c8b01-c681-40c6-8839-fb8fc6f654b1 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:51:00 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:51:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:01 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 1073741824 Jul 11 03:51:01 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:02 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 1073741824" returned: 0 in 1.206s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:02 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 Jul 11 03:51:02 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Flow 'volume_create_manager' (cb0b17cd-2a37-4522-a31a-35b4dd1d55ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f2ea0a-0c5f-4efb-bc16-58ee0915e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f2ea0a-0c5f-4efb-bc16-58ee0915e713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1653218422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b740c613-180f-4b47-a62f-7895a9340043,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac59a8dab1944a2eb29d69f86fb2ef71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:03Z,use_quota=True,user_id='8c6e49a22aae4cf988bb2e0933653fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396f1c52-bf46-4260-af34-a223acdc8c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396f1c52-bf46-4260-af34-a223acdc8c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814229c5-d679-4f3a-bf12-969ae172b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814229c5-d679-4f3a-bf12-969ae172b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b740c613-180f-4b47-a62f-7895a9340043', 'volume_name': 'volume-b740c613-180f-4b47-a62f-7895a9340043', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b05561c-87bc-437c-a6b2-c5ee5729af74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b05561c-87bc-437c-a6b2-c5ee5729af74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aeac43-4ee1-48c0-9dad-6e3ab7326948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:02 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Volume b740c613-180f-4b47-a62f-7895a9340043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b740c613-180f-4b47-a62f-7895a9340043', 'volume_size': 1} Jul 11 03:51:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:03 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1" returned: 0 in 0.983s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] <== create_volume: return (2245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1653218422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b740c613-180f-4b47-a62f-7895a9340043,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac59a8dab1944a2eb29d69f86fb2ef71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:03Z,use_quota=True,user_id='8c6e49a22aae4cf988bb2e0933653fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Creating volume b740c613-180f-4b47-a62f-7895a9340043 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:51:03 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72583a59-1791-4587-8a94-0ed6efd1684b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:03 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 1073741824 Jul 11 03:51:03 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b983a7c-14a4-41b7-95c3-6b6dfcbebf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Volume volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 (0a1c8b01-c681-40c6-8839-fb8fc6f654b1): created successfully Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b983a7c-14a4-41b7-95c3-6b6dfcbebf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Flow 'volume_create_manager' (57145b49-87f8-41b6-b6d4-6779c8a61e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-79a8c42c-28fa-4f29-bc49-b375553c021e tempest-ServerActionsTestOtherA-1307395732 None] Created volume successfully. Jul 11 03:51:04 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 1073741824" returned: 0 in 0.942s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:04 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 Jul 11 03:51:04 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:05 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043" returned: 0 in 0.917s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2aeac43-4ee1-48c0-9dad-6e3ab7326948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b740c613-180f-4b47-a62f-7895a9340043', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0cfddd-0bad-4bfc-ba03-6eca74bb5e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:05 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Volume volume-b740c613-180f-4b47-a62f-7895a9340043 (b740c613-180f-4b47-a62f-7895a9340043): created successfully Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0cfddd-0bad-4bfc-ba03-6eca74bb5e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Flow 'volume_create_manager' (cb0b17cd-2a37-4522-a31a-35b4dd1d55ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b57125d5-3ade-4c2d-b94c-25763747dd53 tempest-VolumesTestJSON-1211664143 None] Created volume successfully. Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Flow 'volume_create_manager' (6144c3c1-aab9-459e-bdab-47dad46a1437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ede6ce-7498-46ae-b450-4c3e0a11fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ede6ce-7498-46ae-b450-4c3e0a11fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1455884409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5b694-ecb1-4425-ba1f-6986b974dac4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac59a8dab1944a2eb29d69f86fb2ef71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:07Z,use_quota=True,user_id='8c6e49a22aae4cf988bb2e0933653fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c3f4fb-8cd1-46f8-b012-2f461bccea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c3f4fb-8cd1-46f8-b012-2f461bccea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b204419-e58d-4cc5-a0c0-4429fe2194de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b204419-e58d-4cc5-a0c0-4429fe2194de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a5b694-ecb1-4425-ba1f-6986b974dac4', 'volume_name': 'volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14d8944-62f4-4d0c-bbe9-ef6e2a172607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14d8944-62f4-4d0c-bbe9-ef6e2a172607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075cc4c3-e7d8-4c2e-bd64-a28b3e4c7bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:06 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Volume d7a5b694-ecb1-4425-ba1f-6986b974dac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4', 'volume_size': 1} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1455884409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a5b694-ecb1-4425-ba1f-6986b974dac4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac59a8dab1944a2eb29d69f86fb2ef71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:07Z,use_quota=True,user_id='8c6e49a22aae4cf988bb2e0933653fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Creating volume d7a5b694-ecb1-4425-ba1f-6986b974dac4 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:51:06 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:51:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:06 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 1073741824 Jul 11 03:51:06 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:08 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 1073741824" returned: 0 in 1.161s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:08 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 Jul 11 03:51:08 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:09 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4" returned: 0 in 1.087s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075cc4c3-e7d8-4c2e-bd64-a28b3e4c7bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55530e4a-335b-4533-be3d-a4da73d80695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Volume volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 (d7a5b694-ecb1-4425-ba1f-6986b974dac4): created successfully Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55530e4a-335b-4533-be3d-a4da73d80695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Flow 'volume_create_manager' (6144c3c1-aab9-459e-bdab-47dad46a1437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fa7df9f5-92b7-4d19-9886-5477ea787a9d tempest-VolumesTestJSON-1211664143 None] Created volume successfully. Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Flow 'volume_create_manager' (2e9a1500-1e8f-4423-addd-0b08c92d7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1e8a9f-eabc-4fa2-a8fb-4afc47ca31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1e8a9f-eabc-4fa2-a8fb-4afc47ca31d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-831529622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02398d32-88f7-418f-8f9a-f5f64fe641ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac59a8dab1944a2eb29d69f86fb2ef71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:10Z,use_quota=True,user_id='8c6e49a22aae4cf988bb2e0933653fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b6d18e-f68c-4f31-8445-d269ec434fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b6d18e-f68c-4f31-8445-d269ec434fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db49c9-c6b7-4373-85cf-3159174ec2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2db49c9-c6b7-4373-85cf-3159174ec2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02398d32-88f7-418f-8f9a-f5f64fe641ae', 'volume_name': 'volume-02398d32-88f7-418f-8f9a-f5f64fe641ae', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4da911-dcfc-497f-95f9-6da026e34570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4da911-dcfc-497f-95f9-6da026e34570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc48292-60d0-472f-b580-919f4000b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Volume 02398d32-88f7-418f-8f9a-f5f64fe641ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02398d32-88f7-418f-8f9a-f5f64fe641ae', 'volume_size': 1} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-831529622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02398d32-88f7-418f-8f9a-f5f64fe641ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac59a8dab1944a2eb29d69f86fb2ef71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:10Z,use_quota=True,user_id='8c6e49a22aae4cf988bb2e0933653fa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Creating volume 02398d32-88f7-418f-8f9a-f5f64fe641ae {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:51:10 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:51:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:10 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae 1073741824 Jul 11 03:51:10 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:11 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae 1073741824" returned: 0 in 0.959s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:11 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae Jul 11 03:51:11 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:12 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae" returned: 0 in 0.705s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc48292-60d0-472f-b580-919f4000b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02398d32-88f7-418f-8f9a-f5f64fe641ae', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e7a140-0bac-4559-87bd-83b58c7ac6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Volume volume-02398d32-88f7-418f-8f9a-f5f64fe641ae (02398d32-88f7-418f-8f9a-f5f64fe641ae): created successfully Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e7a140-0bac-4559-87bd-83b58c7ac6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Flow 'volume_create_manager' (2e9a1500-1e8f-4423-addd-0b08c92d7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-acc22b9b-2294-4064-a077-ecce9c009a21 tempest-VolumesTestJSON-1211664143 None] Created volume successfully. Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Acquiring lock "cinder-02398d32-88f7-418f-8f9a-f5f64fe641ae-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Lock "cinder-02398d32-88f7-418f-8f9a-f5f64fe641ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:14 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:51:14 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Acquiring lock "cinder-quobyte-02398d32-88f7-418f-8f9a-f5f64fe641ae" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Lock "cinder-quobyte-02398d32-88f7-418f-8f9a-f5f64fe641ae" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d9ecd3-296e-45a3-ac36-43e2ff7d6039]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:51:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:14 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae Jul 11 03:51:14 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:15 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.182s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 8 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:51:15 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae" returned: 0 in 1.213s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:15 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae Jul 11 03:51:15 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:16 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-02398d32-88f7-418f-8f9a-f5f64fe641ae" returned: 0 in 0.806s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Lock "cinder-quobyte-02398d32-88f7-418f-8f9a-f5f64fe641ae" released by "delete_volume" :: held 2.071s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Created reservations ['769847fb-7443-40fd-9b6c-a5c21476a4a7', '45fe4f9d-7bb3-4a39-abb4-a8aba3b84037', 'f580cfd9-8b42-43af-b673-c004ef2f4c18', 'd9d14547-5140-425e-a01d-681d6e38c8cd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:16 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:51:16 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:17 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.789s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:51:17 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Deleted volume successfully. Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-46fef805-a649-4242-9b86-d685132e623a tempest-VolumesTestJSON-1211664143 None] Lock "cinder-02398d32-88f7-418f-8f9a-f5f64fe641ae-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "cinder-d7a5b694-ecb1-4425-ba1f-6986b974dac4-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-d7a5b694-ecb1-4425-ba1f-6986b974dac4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "cinder-quobyte-d7a5b694-ecb1-4425-ba1f-6986b974dac4" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-quobyte-d7a5b694-ecb1-4425-ba1f-6986b974dac4" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1dd8c-a566-4dcb-a0a6-365257a978f6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:51:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:17 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 Jul 11 03:51:17 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:18 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4" returned: 0 in 1.078s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:18 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4 Jul 11 03:51:18 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:19 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d7a5b694-ecb1-4425-ba1f-6986b974dac4" returned: 0 in 1.001s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-quobyte-d7a5b694-ecb1-4425-ba1f-6986b974dac4" released by "delete_volume" :: held 2.147s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Created reservations ['0c025eec-42d3-4656-8e91-3b177f2eefc8', 'cbc41705-4859-4fa5-8296-1e533b8b8e00', '4be7ac4d-d869-42a5-bb95-ef7f9dcfa7d6', '3379138d-34d2-4bbc-87fb-6f5ac8f21cc8'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:19 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:51:19 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:20 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.792s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:51:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Deleted volume successfully. Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1676eae7-f871-42fa-9e66-f2a410a7bd16 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-d7a5b694-ecb1-4425-ba1f-6986b974dac4-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "cinder-b740c613-180f-4b47-a62f-7895a9340043-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-b740c613-180f-4b47-a62f-7895a9340043-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "cinder-quobyte-b740c613-180f-4b47-a62f-7895a9340043" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-quobyte-b740c613-180f-4b47-a62f-7895a9340043" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cd9dbf-4f54-45df-9e6e-c03d010b123b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:51:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:21 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 Jul 11 03:51:21 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:21 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043" returned: 0 in 0.862s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:21 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043 Jul 11 03:51:21 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:22 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b740c613-180f-4b47-a62f-7895a9340043" returned: 0 in 1.032s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-quobyte-b740c613-180f-4b47-a62f-7895a9340043" released by "delete_volume" :: held 1.986s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Created reservations ['344ed7d0-5eed-4150-a3e2-27ca085e21b0', '0431be6d-e4ee-4af1-a5e9-fb0dd79f6b4e', 'b6bc17a0-fd38-4925-8a07-150abb2b0ca3', '6c8dd1c3-b02a-4fba-8448-504242658aad'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:23 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:51:23 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:24 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.131s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:24 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:51:24 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Deleted volume successfully. Jul 11 03:51:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90d69aaf-f440-4d50-84a0-5dc8a2008300 tempest-VolumesTestJSON-1211664143 None] Lock "cinder-b740c613-180f-4b47-a62f-7895a9340043-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:51:33 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=69,cinder:DELETE=4,cinder:SELECT=36,cinder:INSERT=12 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:51:34 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=56,cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=8 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:51:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b52d167d-d47e-455f-8336-70fc0b15e255 tempest-BackendsCapabilitiesAdminTestsJSON-1963272117 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87437) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 03:51:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1957ebdb-6d48-446a-aa10-4cd7c00d46e4 tempest-BackendsCapabilitiesAdminTestsJSON-1963272117 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87437) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 03:51:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:51:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Flow 'volume_create_manager' (c72316e6-0fc4-4f2c-838c-dbee78a5f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00a7fce-8921-4030-91d0-6ce960a792ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00a7fce-8921-4030-91d0-6ce960a792ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1637152798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fffa31-9ec4-48fb-80f5-ba69abf5910f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0405958f33ad4ea798f4b31fc12a0ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:52Z,use_quota=True,user_id='9b70f7bcfee34e48855bf6a6fcd99eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327d86d4-808b-4b01-9acc-db9301010314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327d86d4-808b-4b01-9acc-db9301010314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb9ca10-9ca9-418c-b248-14653a8e03e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb9ca10-9ca9-418c-b248-14653a8e03e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fffa31-9ec4-48fb-80f5-ba69abf5910f', 'volume_name': 'volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9cae82-548d-45ea-a590-96b7edded335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9cae82-548d-45ea-a590-96b7edded335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2286cfdb-799b-4708-99b3-6c9d0ee96f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:52 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Volume 44fffa31-9ec4-48fb-80f5-ba69abf5910f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f', 'volume_size': 1} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1637152798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fffa31-9ec4-48fb-80f5-ba69abf5910f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0405958f33ad4ea798f4b31fc12a0ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:51:52Z,use_quota=True,user_id='9b70f7bcfee34e48855bf6a6fcd99eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Creating volume 44fffa31-9ec4-48fb-80f5-ba69abf5910f {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:51:52 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:51:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:52 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f 1073741824 Jul 11 03:51:52 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:53 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f 1073741824" returned: 0 in 1.526s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:51:53 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f Jul 11 03:51:53 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:51:55 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f" returned: 0 in 1.668s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] <== create_volume: return (3267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.274s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2286cfdb-799b-4708-99b3-6c9d0ee96f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c9e3f1-5d89-4f1c-a4dd-dca693c69d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:51:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Volume volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f (44fffa31-9ec4-48fb-80f5-ba69abf5910f): created successfully Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c9e3f1-5d89-4f1c-a4dd-dca693c69d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:51:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Flow 'volume_create_manager' (c72316e6-0fc4-4f2c-838c-dbee78a5f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:51:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e1f2c722-6c74-410e-a370-e688db4be4da tempest-ServerRescueNegativeTestJSON-455153355 None] Created volume successfully. Jul 11 03:52:04 devstack cinder-volume[87437]: WARNING py.warnings [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 11 03:52:04 devstack cinder-volume[87437]: .first() Jul 11 03:52:04 devstack cinder-volume[87437]: Jul 11 03:52:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df02670-027c-4b05-b2bc-84d538d7d9cd]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:05 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 Jul 11 03:52:05 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:06 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1" returned: 0 in 1.442s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.486s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbc61ee8-ffe8-43ec-bc3a-38941d8bb94f', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 03:52:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-5bd0d7e9-99fa-48d0-8a96-39770457cb4d req-97332849-8128-4a31-a47b-79e5f5eb0d4b tempest-ServerActionsTestOtherA-1307395732 None] attachment_update completed successfully. Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Flow 'volume_create_manager' (ae25fe13-6c8b-48f1-bbd2-605898aba513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d1f9e5-86b4-4fea-bfdf-fb9fbcd9daa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d1f9e5-86b4-4fea-bfdf-fb9fbcd9daa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1612776584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940d21bc-2c9c-473d-ba5a-acd28cf0af91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e688a384c34a9d8cceb11e8d87ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:52:08Z,use_quota=True,user_id='f622b2cb20c14c6b840a0ee6a9f9bf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38926cc-5932-4591-ac13-ebf5bfcd23ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38926cc-5932-4591-ac13-ebf5bfcd23ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e287f2f-0b68-4573-8b25-13bcc503c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e287f2f-0b68-4573-8b25-13bcc503c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940d21bc-2c9c-473d-ba5a-acd28cf0af91', 'volume_name': 'volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63ab8fb-b8f8-482f-9a06-fc3630ba2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63ab8fb-b8f8-482f-9a06-fc3630ba2261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b1aac1-2ace-4322-8f66-be288858786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Volume 940d21bc-2c9c-473d-ba5a-acd28cf0af91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91', 'volume_size': 1} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1612776584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940d21bc-2c9c-473d-ba5a-acd28cf0af91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e688a384c34a9d8cceb11e8d87ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:52:08Z,use_quota=True,user_id='f622b2cb20c14c6b840a0ee6a9f9bf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Creating volume 940d21bc-2c9c-473d-ba5a-acd28cf0af91 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:52:07 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:52:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:07 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 1073741824 Jul 11 03:52:07 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:09 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 1073741824" returned: 0 in 1.677s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:09 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 Jul 11 03:52:09 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:10 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91" returned: 0 in 1.076s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] <== create_volume: return (2832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.837s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b1aac1-2ace-4322-8f66-be288858786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be82201e-417e-4604-ba58-4f7f44ada5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Volume volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 (940d21bc-2c9c-473d-ba5a-acd28cf0af91): created successfully Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be82201e-417e-4604-ba58-4f7f44ada5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Flow 'volume_create_manager' (ae25fe13-6c8b-48f1-bbd2-605898aba513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:52:10 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cfddbfe1-4ca6-4eb1-ae24-b269978e747b tempest-DeleteServersTestJSON-978946561 None] Created volume successfully. Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:14 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:52:14 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:15 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.822s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:52:15 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:52:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 8 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:52:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:52:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:16 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dda19e-7e7d-49ec-bd33-969b608b1ed3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:16 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 Jul 11 03:52:16 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-f57705e8-a03e-470a-a196-8c1a09626522 tempest-ServerActionsTestOtherA-1307395732 None] Terminate volume connection completed successfully. Jul 11 03:52:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-f57705e8-a03e-470a-a196-8c1a09626522 tempest-ServerActionsTestOtherA-1307395732 None] Deleting attachment bbc61ee8-ffe8-43ec-bc3a-38941d8bb94f. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 03:52:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Acquiring lock "cinder-44fffa31-9ec4-48fb-80f5-ba69abf5910f-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "cinder-44fffa31-9ec4-48fb-80f5-ba69abf5910f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Acquiring lock "cinder-quobyte-44fffa31-9ec4-48fb-80f5-ba69abf5910f" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "cinder-quobyte-44fffa31-9ec4-48fb-80f5-ba69abf5910f" acquired by "delete_volume" :: waited 0.071s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f564ff-a6f1-42eb-89f9-6b4bfcbed748]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:17 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f Jul 11 03:52:17 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:18 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91" returned: 0 in 2.130s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.165s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49e5a13f-1b6c-47fd-94f3-777dd320ec14', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 03:52:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-d380a3f6-5994-4a20-8f1a-6b043192501c req-21b33f23-039a-49df-9771-98da6ba32e1e tempest-DeleteServersTestJSON-978946561 None] attachment_update completed successfully. Jul 11 03:52:19 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f" returned: 0 in 1.908s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:19 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f Jul 11 03:52:19 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3cd4ab-6251-4c4a-98a0-464954e35709]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:19 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1 Jul 11 03:52:19 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:20 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44fffa31-9ec4-48fb-80f5-ba69abf5910f" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "cinder-quobyte-44fffa31-9ec4-48fb-80f5-ba69abf5910f" released by "delete_volume" :: held 2.710s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Created reservations ['ee989d90-11ef-43aa-82e0-3b0da4378bc5', 'bc969766-fb39-4f70-b7e8-24e160c19aa7', '95b16099-5cb0-4fd1-99c2-15fd002b61dd', 'e2e8b3cf-2a91-425b-b9d9-2bdcfcd08e8a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:20 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:52:20 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:20 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1" returned: 0 in 1.034s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.053s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-0a1c8b01-c681-40c6-8839-fb8fc6f654b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4dbbba0-d027-4c49-8d09-7277c7da49ae', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 03:52:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-8012d6ec-667b-4105-a17d-5e8230f74720 req-60ccaaf6-24c6-4edf-9a27-2553e44a9d9d tempest-ServerActionsTestOtherA-1307395732 None] attachment_update completed successfully. Jul 11 03:52:21 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.758s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:21 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:52:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Deleted volume successfully. Jul 11 03:52:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3f299dfc-8ecf-46d0-98db-180ef0c900bc tempest-ServerRescueNegativeTestJSON-455153355 None] Lock "cinder-44fffa31-9ec4-48fb-80f5-ba69abf5910f-delete_volume" released by "delete_volume" :: held 3.880s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-4f259d76-e613-4b5d-8909-3e6fc584fc39 req-cc34a03a-2a20-4e39-9de8-38054eb5b70d tempest-DeleteServersTestJSON-978946561 None] Terminate volume connection completed successfully. Jul 11 03:52:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-4f259d76-e613-4b5d-8909-3e6fc584fc39 req-cc34a03a-2a20-4e39-9de8-38054eb5b70d tempest-DeleteServersTestJSON-978946561 None] Deleting attachment 49e5a13f-1b6c-47fd-94f3-777dd320ec14. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Flow 'volume_create_manager' (0ac4b9ad-6f49-4244-95be-8306a7d56abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090518d0-ffde-4c6c-97e5-1441fc2949a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090518d0-ffde-4c6c-97e5-1441fc2949a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1339334744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f771e18-b7a2-4ce6-a095-6b70e7cfd808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf0e1b0db8d4e20ace133010aeca2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:52:31Z,use_quota=True,user_id='6a26e52283594f128495c561e35b9ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993752b7-2e7d-4903-a2f8-c48322693a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993752b7-2e7d-4903-a2f8-c48322693a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d0fa81-87b7-490b-a996-6426ff6b8ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d0fa81-87b7-490b-a996-6426ff6b8ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f771e18-b7a2-4ce6-a095-6b70e7cfd808', 'volume_name': 'volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef44a600-bb47-47ff-a161-7eddf8c3b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef44a600-bb47-47ff-a161-7eddf8c3b27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ed0904-dc7d-4f36-9280-000a7813aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Volume 0f771e18-b7a2-4ce6-a095-6b70e7cfd808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808', 'volume_size': 1} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1339334744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f771e18-b7a2-4ce6-a095-6b70e7cfd808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf0e1b0db8d4e20ace133010aeca2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:52:31Z,use_quota=True,user_id='6a26e52283594f128495c561e35b9ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Creating volume 0f771e18-b7a2-4ce6-a095-6b70e7cfd808 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:52:31 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:52:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:31 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 1073741824 Jul 11 03:52:31 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:32 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 1073741824" returned: 0 in 1.020s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:32 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 Jul 11 03:52:32 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:33 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808" returned: 0 in 0.706s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ed0904-dc7d-4f36-9280-000a7813aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293b4e5d-6e94-4a31-9bf0-f542fd29441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:33 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Volume volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 (0f771e18-b7a2-4ce6-a095-6b70e7cfd808): created successfully Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293b4e5d-6e94-4a31-9bf0-f542fd29441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Flow 'volume_create_manager' (0ac4b9ad-6f49-4244-95be-8306a7d56abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:52:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-13b2f001-fcef-499a-aaf6-a38a04389849 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Created volume successfully. Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "cinder-0f771e18-b7a2-4ce6-a095-6b70e7cfd808-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "cinder-0f771e18-b7a2-4ce6-a095-6b70e7cfd808-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "cinder-quobyte-0f771e18-b7a2-4ce6-a095-6b70e7cfd808" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "cinder-quobyte-0f771e18-b7a2-4ce6-a095-6b70e7cfd808" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eafb27-e72b-4529-bfca-d6025368c069]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:33 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 Jul 11 03:52:33 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:34 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808" returned: 0 in 0.771s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:34 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808 Jul 11 03:52:34 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Acquiring lock "cinder-940d21bc-2c9c-473d-ba5a-acd28cf0af91-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Lock "cinder-940d21bc-2c9c-473d-ba5a-acd28cf0af91-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Acquiring lock "cinder-quobyte-940d21bc-2c9c-473d-ba5a-acd28cf0af91" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Lock "cinder-quobyte-940d21bc-2c9c-473d-ba5a-acd28cf0af91" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[796e9486-23aa-4804-82a6-970b577753f1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:34 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 Jul 11 03:52:34 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:35 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0f771e18-b7a2-4ce6-a095-6b70e7cfd808" returned: 0 in 0.700s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "cinder-quobyte-0f771e18-b7a2-4ce6-a095-6b70e7cfd808" released by "delete_volume" :: held 1.520s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Created reservations ['e6b60272-d5fb-4f84-9d21-a35a8257c829', '20941a76-867b-4e15-ba25-5172776ce049', 'ee805a87-b49a-4d4f-8dfc-7183fa3d9e29', 'd96196e5-e33f-46c6-af22-36db80aa9d80'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:35 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:52:35 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:35 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91" returned: 0 in 0.809s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:35 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91 Jul 11 03:52:35 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:35 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.652s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:35 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:52:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Deleted volume successfully. Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80702bb0-03e4-4fa5-a9d6-3661a888c71b tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "cinder-0f771e18-b7a2-4ce6-a095-6b70e7cfd808-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:36 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-940d21bc-2c9c-473d-ba5a-acd28cf0af91" returned: 0 in 0.688s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Lock "cinder-quobyte-940d21bc-2c9c-473d-ba5a-acd28cf0af91" released by "delete_volume" :: held 1.545s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Created reservations ['08729ffd-b7d9-4beb-b734-1a9123c723ef', '527af4c2-b404-42ee-adf2-ecedf7fd0f98', 'd4f6f8bf-29be-473b-9ee9-a0379c6bf3e7', '186569ed-8e47-4f8a-8fdf-4d464235a533'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:36 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:52:36 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Flow 'volume_create_manager' (99badaf1-2d76-427f-8799-d011094998d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b84aef-59b1-475a-a351-5442447d76c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b84aef-59b1-475a-a351-5442447d76c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-208889540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d38754-ec37-4822-8f5d-6adbde751dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf0e1b0db8d4e20ace133010aeca2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:52:36Z,use_quota=True,user_id='6a26e52283594f128495c561e35b9ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2caf1c5e-9309-4564-ba81-ea0780b4f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2caf1c5e-9309-4564-ba81-ea0780b4f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3a9f4a-71c4-4aed-aa67-60cdcdfd8e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3a9f4a-71c4-4aed-aa67-60cdcdfd8e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d38754-ec37-4822-8f5d-6adbde751dac', 'volume_name': 'volume-43d38754-ec37-4822-8f5d-6adbde751dac', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb18441-88fa-4c04-aebc-973b74bda906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb18441-88fa-4c04-aebc-973b74bda906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa22f2f3-02f3-420d-a57e-8623bd839340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:36 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Volume 43d38754-ec37-4822-8f5d-6adbde751dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d38754-ec37-4822-8f5d-6adbde751dac', 'volume_size': 1} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-208889540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d38754-ec37-4822-8f5d-6adbde751dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf0e1b0db8d4e20ace133010aeca2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:52:36Z,use_quota=True,user_id='6a26e52283594f128495c561e35b9ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Creating volume 43d38754-ec37-4822-8f5d-6adbde751dac {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:52:36 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:52:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:36 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac 1073741824 Jul 11 03:52:36 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:37 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.780s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:37 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:52:37 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Deleted volume successfully. Jul 11 03:52:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6a7e7db9-324b-4f38-ae5e-03192772df85 tempest-DeleteServersTestJSON-978946561 None] Lock "cinder-940d21bc-2c9c-473d-ba5a-acd28cf0af91-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:37 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac 1073741824" returned: 0 in 1.053s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:37 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac Jul 11 03:52:37 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:38 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac" returned: 0 in 0.829s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa22f2f3-02f3-420d-a57e-8623bd839340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d38754-ec37-4822-8f5d-6adbde751dac', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c912cd-7956-4a1b-893d-1e43c1388343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:52:38 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Volume volume-43d38754-ec37-4822-8f5d-6adbde751dac (43d38754-ec37-4822-8f5d-6adbde751dac): created successfully Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c912cd-7956-4a1b-893d-1e43c1388343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:52:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Flow 'volume_create_manager' (99badaf1-2d76-427f-8799-d011094998d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:52:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-af0b3614-00de-4a7f-af8e-8e22e8bc2c65 tempest-VolumeQuotasAdminTestJSON-1267448712 None] Created volume successfully. Jul 11 03:52:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e6731d22-d936-4ed0-a1d8-fb13a7c90fdf tempest-VolumeQuotasAdminTestJSON-1649829498 None] Transfer volume completed successfully. Jul 11 03:52:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Acquiring lock "cinder-43d38754-ec37-4822-8f5d-6adbde751dac-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Lock "cinder-43d38754-ec37-4822-8f5d-6adbde751dac-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Acquiring lock "cinder-quobyte-43d38754-ec37-4822-8f5d-6adbde751dac" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:52:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Lock "cinder-quobyte-43d38754-ec37-4822-8f5d-6adbde751dac" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:52:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f295818f-7e4c-4eef-bb17-58bf9f71d217]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:52:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:41 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac Jul 11 03:52:41 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:42 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac" returned: 0 in 0.917s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:42 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac Jul 11 03:52:42 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:43 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-43d38754-ec37-4822-8f5d-6adbde751dac" returned: 0 in 0.735s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Lock "cinder-quobyte-43d38754-ec37-4822-8f5d-6adbde751dac" released by "delete_volume" :: held 1.695s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Created reservations ['5336c47e-8c85-4d48-9bcf-b23ec158ab1b', '23802974-3cd9-4e34-9322-7b0ce16317ef', '6f2df73d-f2b1-42ef-bf6f-36ae0ff6d3b8', '121a78f9-6473-4124-b463-b53cfbf9063c'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:52:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:52:43 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:52:43 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:52:44 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Jul 11 03:52:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.878s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:52:44 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:52:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Deleted volume successfully. Jul 11 03:52:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b0ea6d77-882f-45fb-a093-532f8fb27861 tempest-VolumeQuotasAdminTestJSON-886182089 None] Lock "cinder-43d38754-ec37-4822-8f5d-6adbde751dac-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:52:53 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=53,cinder:DELETE=5 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:52:54 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=55,cinder:UPDATE=44,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Flow 'volume_create_manager' (2f6bf319-032e-4f12-9d9d-5fab9aba0170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04109d6-5bf3-48b3-ab7b-faed63354feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04109d6-5bf3-48b3-ab7b-faed63354feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1887113747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c18ece4-335d-4b99-917d-a7626cc9d2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589bdc7f7705432cac24debfbd9c8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:03Z,use_quota=True,user_id='951e7399d7394172b3e1f49ec4dcc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2babca-44fb-4653-893b-c129484189db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2babca-44fb-4653-893b-c129484189db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d9392b-4963-461b-906c-5fde14a4c470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d9392b-4963-461b-906c-5fde14a4c470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c18ece4-335d-4b99-917d-a7626cc9d2bd', 'volume_name': 'volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84bf637-68ca-4166-949a-37b0a13b2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84bf637-68ca-4166-949a-37b0a13b2b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b686fa-60ef-4cec-8110-d153dbed0c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Volume 4c18ece4-335d-4b99-917d-a7626cc9d2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd', 'volume_size': 1} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1887113747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c18ece4-335d-4b99-917d-a7626cc9d2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='589bdc7f7705432cac24debfbd9c8ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:03Z,use_quota=True,user_id='951e7399d7394172b3e1f49ec4dcc04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Creating volume 4c18ece4-335d-4b99-917d-a7626cc9d2bd {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:53:03 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:03 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd 1073741824 Jul 11 03:53:03 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:03 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd 1073741824" returned: 0 in 0.894s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:04 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd Jul 11 03:53:04 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:04 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd" returned: 0 in 0.770s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b686fa-60ef-4cec-8110-d153dbed0c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c4a852-1968-4b04-a349-57f244e9eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Volume volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd (4c18ece4-335d-4b99-917d-a7626cc9d2bd): created successfully Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c4a852-1968-4b04-a349-57f244e9eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Flow 'volume_create_manager' (2f6bf319-032e-4f12-9d9d-5fab9aba0170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:04 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-81e2c227-52eb-4ad0-bd7a-4d87df27ff59 tempest-VolumeQuotasNegativeTestJSON-207190158 None] Created volume successfully. Jul 11 03:53:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Acquiring lock "cinder-4c18ece4-335d-4b99-917d-a7626cc9d2bd-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:53:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "cinder-4c18ece4-335d-4b99-917d-a7626cc9d2bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:53:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Acquiring lock "cinder-quobyte-4c18ece4-335d-4b99-917d-a7626cc9d2bd" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:53:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "cinder-quobyte-4c18ece4-335d-4b99-917d-a7626cc9d2bd" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:53:06 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc798bab-00a4-4004-b75b-4d0386ca5451]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:53:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:06 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd Jul 11 03:53:06 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:07 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd" returned: 0 in 0.922s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:07 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd Jul 11 03:53:07 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:07 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4c18ece4-335d-4b99-917d-a7626cc9d2bd" returned: 0 in 0.902s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "cinder-quobyte-4c18ece4-335d-4b99-917d-a7626cc9d2bd" released by "delete_volume" :: held 1.882s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Created reservations ['38d06ada-4d62-441c-b8c5-41f93d36e7d9', '0d0476db-f23f-45a3-8116-54a50664ba10', '3ff5c2df-f4bf-4905-85c5-572b813a1bf6', '4e412005-2789-4695-b757-df60dc136bbb'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:08 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:53:08 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:08 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.810s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:08 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:53:08 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Deleted volume successfully. Jul 11 03:53:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7a679ba8-f26e-4dc6-81e8-bfd4af54822d tempest-VolumeQuotasNegativeTestJSON-207190158 None] Lock "cinder-4c18ece4-335d-4b99-917d-a7626cc9d2bd-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:14 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:53:14 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:14 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.908s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Flow 'volume_create_manager' (dab8ae30-acda-472d-a05b-dac915ccd7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b157d2b9-9dda-4d2e-bd94-6e732efeef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b157d2b9-9dda-4d2e-bd94-6e732efeef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-436735069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04da865e-bb71-4cea-9ce6-bfaa35224f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a471a0eb3b614a629f8c21b4b25a6012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:15Z,use_quota=True,user_id='f6daf01efbf549b9b682dcbc77bb9378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b83601-bac5-4a34-bb19-a1ca5c03366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b83601-bac5-4a34-bb19-a1ca5c03366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d01df2-3176-4b8f-9579-4cf68f596262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d01df2-3176-4b8f-9579-4cf68f596262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04da865e-bb71-4cea-9ce6-bfaa35224f11', 'volume_name': 'volume-04da865e-bb71-4cea-9ce6-bfaa35224f11', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5512b3df-bb1c-4c70-9787-f81f8673a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5512b3df-bb1c-4c70-9787-f81f8673a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b6e8b4-e354-47f9-80f7-ab17f6ef1862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Volume 04da865e-bb71-4cea-9ce6-bfaa35224f11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04da865e-bb71-4cea-9ce6-bfaa35224f11', 'volume_size': 1} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-436735069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04da865e-bb71-4cea-9ce6-bfaa35224f11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a471a0eb3b614a629f8c21b4b25a6012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:15Z,use_quota=True,user_id='f6daf01efbf549b9b682dcbc77bb9378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Creating volume 04da865e-bb71-4cea-9ce6-bfaa35224f11 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:53:15 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:53:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:15 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 1073741824 Jul 11 03:53:15 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:16 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 1073741824" returned: 0 in 0.986s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:16 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 Jul 11 03:53:16 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:17 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11" returned: 0 in 0.844s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b6e8b4-e354-47f9-80f7-ab17f6ef1862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04da865e-bb71-4cea-9ce6-bfaa35224f11', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7069faf-b067-4709-a13b-022eee94dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Volume volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 (04da865e-bb71-4cea-9ce6-bfaa35224f11): created successfully Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7069faf-b067-4709-a13b-022eee94dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Flow 'volume_create_manager' (dab8ae30-acda-472d-a05b-dac915ccd7e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:17 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c5e25fd7-bdd0-4f70-a30c-04bc10778e16 tempest-TaggedAttachmentsTest-672762497 None] Created volume successfully. Jul 11 03:53:27 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=8,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:53:27 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:53:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:53:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Flow 'volume_create_manager' (df5c8abe-119a-44a4-8ce8-73d61ecf8c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89820d62-d2fa-4dd7-b4c4-c62ae5c1c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89820d62-d2fa-4dd7-b4c4-c62ae5c1c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-562072009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50c7c6c-67f9-4f30-a756-a0aa079b8c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e63ffe55adc48cd92bc64afb26771f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:51Z,use_quota=True,user_id='c0e4f03e390944649ff022970eaa5be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f6f9bc-eed0-4ff4-a9d6-4a87e587c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f6f9bc-eed0-4ff4-a9d6-4a87e587c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccd252f-a2b8-40a1-be73-be69ab31c185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccd252f-a2b8-40a1-be73-be69ab31c185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50c7c6c-67f9-4f30-a756-a0aa079b8c99', 'volume_name': 'volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79161d70-fa1b-424a-951c-4ef07592432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79161d70-fa1b-424a-951c-4ef07592432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d6f24c-bfe2-4fa9-9c88-394f5b68ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Volume c50c7c6c-67f9-4f30-a756-a0aa079b8c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99', 'volume_size': 1} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-562072009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50c7c6c-67f9-4f30-a756-a0aa079b8c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e63ffe55adc48cd92bc64afb26771f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:51Z,use_quota=True,user_id='c0e4f03e390944649ff022970eaa5be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Creating volume c50c7c6c-67f9-4f30-a756-a0aa079b8c99 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:53:50 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:53:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:50 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 1073741824 Jul 11 03:53:50 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:51 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 1073741824" returned: 0 in 0.856s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:51 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 Jul 11 03:53:51 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:52 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d6f24c-bfe2-4fa9-9c88-394f5b68ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60f5188-793a-4372-ba23-fd6062403f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:52 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Volume volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 (c50c7c6c-67f9-4f30-a756-a0aa079b8c99): created successfully Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60f5188-793a-4372-ba23-fd6062403f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Flow 'volume_create_manager' (df5c8abe-119a-44a4-8ce8-73d61ecf8c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-720fa011-f7b7-4e0c-b2ca-6f7383c88bac tempest-ServersNegativeTestJSON-1272665202 None] Created volume successfully. Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Flow 'volume_create_manager' (c31da293-7c0c-4c75-a91c-60721763f49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958cacfd-2374-42fc-8065-5e4664f17b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958cacfd-2374-42fc-8065-5e4664f17b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-547987640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ddc35a-565d-4a1b-bd7e-29941cdc8484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e63ffe55adc48cd92bc64afb26771f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:55Z,use_quota=True,user_id='c0e4f03e390944649ff022970eaa5be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f8b0f-17bd-4101-bf10-387ae781e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f8b0f-17bd-4101-bf10-387ae781e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2ce15a-da49-436b-a161-31e7453026aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb2ce15a-da49-436b-a161-31e7453026aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ddc35a-565d-4a1b-bd7e-29941cdc8484', 'volume_name': 'volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee564357-e285-45b9-b4c1-5fae66f3df25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee564357-e285-45b9-b4c1-5fae66f3df25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98f25d9-9ebc-484e-bcdc-d6eebadd9320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:54 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Volume 91ddc35a-565d-4a1b-bd7e-29941cdc8484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484', 'volume_size': 1} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-547987640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ddc35a-565d-4a1b-bd7e-29941cdc8484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e63ffe55adc48cd92bc64afb26771f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:53:55Z,use_quota=True,user_id='c0e4f03e390944649ff022970eaa5be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Creating volume 91ddc35a-565d-4a1b-bd7e-29941cdc8484 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:53:54 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:53:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:54 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 1073741824 Jul 11 03:53:54 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:55 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 1073741824" returned: 0 in 0.927s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:55 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 Jul 11 03:53:55 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:56 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98f25d9-9ebc-484e-bcdc-d6eebadd9320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145fb94-feef-4524-b9b6-d244262a37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:53:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Volume volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 (91ddc35a-565d-4a1b-bd7e-29941cdc8484): created successfully Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6145fb94-feef-4524-b9b6-d244262a37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:53:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Flow 'volume_create_manager' (c31da293-7c0c-4c75-a91c-60721763f49c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:53:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3f9b1af2-4bd7-4da6-940b-90ff9a2a04ab tempest-ServersNegativeTestJSON-1272665202 None] Created volume successfully. Jul 11 03:53:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "cinder-91ddc35a-565d-4a1b-bd7e-29941cdc8484-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:53:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-91ddc35a-565d-4a1b-bd7e-29941cdc8484-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:53:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "cinder-quobyte-91ddc35a-565d-4a1b-bd7e-29941cdc8484" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:53:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-quobyte-91ddc35a-565d-4a1b-bd7e-29941cdc8484" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:53:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[275e5f84-a6a0-47ce-8676-9c6d6fd2529c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:53:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:57 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 Jul 11 03:53:57 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:58 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484" returned: 0 in 0.975s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:58 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484 Jul 11 03:53:58 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:58 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91ddc35a-565d-4a1b-bd7e-29941cdc8484" returned: 0 in 0.738s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-quobyte-91ddc35a-565d-4a1b-bd7e-29941cdc8484" released by "delete_volume" :: held 1.763s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Created reservations ['3c81e103-616a-4289-9a8b-a74789d368cd', '5c4d4a0f-f9a5-45bf-b0a7-c328a79b6d65', 'a07ca936-bbc2-4f6c-9200-b858ded17abf', '459f6d4b-ec80-4524-ac1d-0663bae7d854'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:53:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:59 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:53:59 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "cinder-c50c7c6c-67f9-4f30-a756-a0aa079b8c99-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-c50c7c6c-67f9-4f30-a756-a0aa079b8c99-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "cinder-quobyte-c50c7c6c-67f9-4f30-a756-a0aa079b8c99" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-quobyte-c50c7c6c-67f9-4f30-a756-a0aa079b8c99" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0dc3dd-b019-44e0-a6db-902bfc895c30]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:53:59 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 Jul 11 03:53:59 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:53:59 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:53:59 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Deleted volume successfully. Jul 11 03:53:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85532189-8b97-449c-b462-d81cf0190b77 tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-91ddc35a-565d-4a1b-bd7e-29941cdc8484-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:00 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99" returned: 0 in 0.852s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:00 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99 Jul 11 03:54:00 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:01 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c50c7c6c-67f9-4f30-a756-a0aa079b8c99" returned: 0 in 0.713s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-quobyte-c50c7c6c-67f9-4f30-a756-a0aa079b8c99" released by "delete_volume" :: held 1.618s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Created reservations ['d01e4206-8a9a-4902-9647-a8b4e50869f0', '1080ac82-aa22-4fcb-acaa-57226295b41a', 'e610c2a3-291c-4c2f-b62a-913d4162b7ec', 'e47e5cec-a7bb-4554-842f-c4a87aae0270'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:01 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:01 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:02 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.919s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Deleted volume successfully. Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0d1916b-70a2-4644-8961-7a92242456eb tempest-ServersNegativeTestJSON-1272665202 None] Lock "cinder-c50c7c6c-67f9-4f30-a756-a0aa079b8c99-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (905ea4b2-f6ec-4e35-bdad-73347976192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ecedbd-4265-436b-98f6-c4f6b9037d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ecedbd-4265-436b-98f6-c4f6b9037d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-428479005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f81e50-0953-412e-a200-299d5e39a1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:02Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94de7b4-93ca-4030-8d42-45f0c6c5c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94de7b4-93ca-4030-8d42-45f0c6c5c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33df2dd5-eb24-4e8c-b8a5-b553204abd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33df2dd5-eb24-4e8c-b8a5-b553204abd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f81e50-0953-412e-a200-299d5e39a1fa', 'volume_name': 'volume-20f81e50-0953-412e-a200-299d5e39a1fa', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d6ea69-4cf5-406b-8f2c-42ecb8471f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d6ea69-4cf5-406b-8f2c-42ecb8471f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4256d636-9cf0-43d1-b3b8-8272de1493ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:02 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Volume 20f81e50-0953-412e-a200-299d5e39a1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f81e50-0953-412e-a200-299d5e39a1fa', 'volume_size': 1} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-428479005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f81e50-0953-412e-a200-299d5e39a1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:02Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Creating volume 20f81e50-0953-412e-a200-299d5e39a1fa {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:02 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:02 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa 1073741824 Jul 11 03:54:02 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:03 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa 1073741824" returned: 0 in 1.022s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:03 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa Jul 11 03:54:03 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:04 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa" returned: 0 in 1.030s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4256d636-9cf0-43d1-b3b8-8272de1493ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f81e50-0953-412e-a200-299d5e39a1fa', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b90903-c15e-4652-b2b9-c7e2599ca262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Volume volume-20f81e50-0953-412e-a200-299d5e39a1fa (20f81e50-0953-412e-a200-299d5e39a1fa): created successfully Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b90903-c15e-4652-b2b9-c7e2599ca262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (905ea4b2-f6ec-4e35-bdad-73347976192a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:04 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2c552fee-e5d5-4e88-9498-b675bb7cb626 tempest-VolumesActionsTest-905746502 None] Created volume successfully. Jul 11 03:54:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d4c3216d-55bc-4438-a981-e24e892db1c9 tempest-VolumesActionsTest-905746502 None] Acquiring lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa" by "attach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d4c3216d-55bc-4438-a981-e24e892db1c9 tempest-VolumesActionsTest-905746502 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa" acquired by "attach_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d4c3216d-55bc-4438-a981-e24e892db1c9 tempest-VolumesActionsTest-905746502 None] Attaching volume 20f81e50-0953-412e-a200-299d5e39a1fa to instance 7cac8022-d467-47f8-9e1b-c31e2fec2efe at mountpoint /dev/vdb on host None. Jul 11 03:54:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d4c3216d-55bc-4438-a981-e24e892db1c9 tempest-VolumesActionsTest-905746502 None] Attach volume completed successfully. Jul 11 03:54:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d4c3216d-55bc-4438-a981-e24e892db1c9 tempest-VolumesActionsTest-905746502 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa" released by "attach_volume" :: held 0.101s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7b47282f-9237-4458-9ca1-4375d4202324 tempest-VolumesActionsTest-1310083591 None] Terminate volume connection completed successfully. Jul 11 03:54:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7b47282f-9237-4458-9ca1-4375d4202324 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-detach_volume" by "detach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7b47282f-9237-4458-9ca1-4375d4202324 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7b47282f-9237-4458-9ca1-4375d4202324 tempest-VolumesActionsTest-1310083591 None] Detaching volume 20f81e50-0953-412e-a200-299d5e39a1fa from instance 7cac8022-d467-47f8-9e1b-c31e2fec2efe. Jul 11 03:54:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7b47282f-9237-4458-9ca1-4375d4202324 tempest-VolumesActionsTest-1310083591 None] Detach volume completed successfully. Jul 11 03:54:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7b47282f-9237-4458-9ca1-4375d4202324 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-28831112-d6c8-4fd3-9055-893170b16f70 tempest-VolumesActionsTest-905746502 None] Acquiring lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-detach_volume" by "detach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-28831112-d6c8-4fd3-9055-893170b16f70 tempest-VolumesActionsTest-905746502 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-28831112-d6c8-4fd3-9055-893170b16f70 tempest-VolumesActionsTest-905746502 None] Volume detach called, but volume not attached. Jul 11 03:54:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-28831112-d6c8-4fd3-9055-893170b16f70 tempest-VolumesActionsTest-905746502 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Acquiring lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Acquiring lock "cinder-quobyte-20f81e50-0953-412e-a200-299d5e39a1fa" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Lock "cinder-quobyte-20f81e50-0953-412e-a200-299d5e39a1fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[75076347-ddb2-4cd5-97cc-17a13264b43a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:08 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa Jul 11 03:54:08 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:09 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa" returned: 0 in 0.794s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:09 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa Jul 11 03:54:09 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:10 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20f81e50-0953-412e-a200-299d5e39a1fa" returned: 0 in 1.133s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Lock "cinder-quobyte-20f81e50-0953-412e-a200-299d5e39a1fa" released by "delete_volume" :: held 1.990s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Created reservations ['757cb2c6-d2bb-4ae7-b5e0-1db46367cb8e', 'b61d1c38-1bd5-4ea5-8556-3671b43131de', '60d6fed3-654a-4917-9512-349fbb0fcd1f', '1c532487-10ad-45c3-8c94-c201c4503c42'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:10 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:10 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:12 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.163s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Deleted volume successfully. Jul 11 03:54:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-24e52ddc-3b2c-40b9-9902-09d056c040bf tempest-VolumesActionsTest-905746502 None] Lock "cinder-20f81e50-0953-412e-a200-299d5e39a1fa-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:14 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:14 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:14 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.814s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 8 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:54:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:54:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8ab55df0-8c71-452a-871e-316c8806600f tempest-GroupSnapshotsTest-2053328560 None] Group tempest-GroupSnapshotsTest-Group-1677896724: creating Jul 11 03:54:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8ab55df0-8c71-452a-871e-316c8806600f tempest-GroupSnapshotsTest-2053328560 None] Group tempest-GroupSnapshotsTest-Group-1677896724: created successfully Jul 11 03:54:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8ab55df0-8c71-452a-871e-316c8806600f tempest-GroupSnapshotsTest-2053328560 None] Create group completed successfully. Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (107478fc-6807-4015-b84f-2e3a82877952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f19d4a7-0ee3-49fd-b020-9ee152f77af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f19d4a7-0ee3-49fd-b020-9ee152f77af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1017424597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ab969f-8e1a-4959-a231-0ceb7f236104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:19Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50469745-16bc-4515-8b16-66ff7da7f69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50469745-16bc-4515-8b16-66ff7da7f69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff907b9-fa4c-4352-9d69-ac48162872b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff907b9-fa4c-4352-9d69-ac48162872b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ab969f-8e1a-4959-a231-0ceb7f236104', 'volume_name': 'volume-81ab969f-8e1a-4959-a231-0ceb7f236104', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2d1d48-5a78-4d0a-b300-41e657cc9126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2d1d48-5a78-4d0a-b300-41e657cc9126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fbf589-57e1-4b98-809a-ce741184f533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:19 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Volume 81ab969f-8e1a-4959-a231-0ceb7f236104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ab969f-8e1a-4959-a231-0ceb7f236104', 'volume_size': 1} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1017424597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ab969f-8e1a-4959-a231-0ceb7f236104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:19Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Creating volume 81ab969f-8e1a-4959-a231-0ceb7f236104 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:19 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:19 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 1073741824 Jul 11 03:54:19 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:19 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 1073741824" returned: 0 in 0.854s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:20 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 Jul 11 03:54:20 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (6e3613d9-1a4d-4b0a-a4c6-435fb115a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb1a632-1070-4371-aeae-e98a65aa7723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb1a632-1070-4371-aeae-e98a65aa7723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124274435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da1ff72b-7983-49ca-9967-8e91382fd08c,host='devstack@QuobyteHD#QuobyteHD',id=a60c7bfe-05b8-447c-be0d-a52ea8e4be20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:20Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cd6046-4e7d-4757-9734-c17d58067bfa),volume_type_id=97cd6046-4e7d-4757-9734-c17d58067bfa)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81c543e-56e3-4d0b-ac76-10e66e9cd120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81c543e-56e3-4d0b-ac76-10e66e9cd120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c3a23d-aca4-4408-bb35-1c6a8275e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c3a23d-aca4-4408-bb35-1c6a8275e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60c7bfe-05b8-447c-be0d-a52ea8e4be20', 'volume_name': 'volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ec92f8-9962-407e-8edf-3ad4ce2c379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ec92f8-9962-407e-8edf-3ad4ce2c379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3e868f-1e32-4559-a568-24a1a109214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Volume a60c7bfe-05b8-447c-be0d-a52ea8e4be20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20', 'volume_size': 1} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:20 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da1ff72b-7983-49ca-9967-8e91382fd08c,created_at=2026-07-11T01:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-124274435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da1ff72b-7983-49ca-9967-8e91382fd08c,host='devstack@QuobyteHD#QuobyteHD',id=a60c7bfe-05b8-447c-be0d-a52ea8e4be20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:20Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97cd6046-4e7d-4757-9734-c17d58067bfa),volume_type_id=97cd6046-4e7d-4757-9734-c17d58067bfa)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Creating volume a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:20 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:20 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 1073741824 Jul 11 03:54:20 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fbf589-57e1-4b98-809a-ce741184f533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ab969f-8e1a-4959-a231-0ceb7f236104', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc33a98-a4b7-44a9-b734-278d7408c05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Volume volume-81ab969f-8e1a-4959-a231-0ceb7f236104 (81ab969f-8e1a-4959-a231-0ceb7f236104): created successfully Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc33a98-a4b7-44a9-b734-278d7408c05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (107478fc-6807-4015-b84f-2e3a82877952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-88ecffdf-e8fb-4f69-9690-af24f5bfdbd8 tempest-VolumesActionsTest-905746502 None] Created volume successfully. Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-81ab969f-8e1a-4959-a231-0ceb7f236104-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Lock "cinder-81ab969f-8e1a-4959-a231-0ceb7f236104-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-quobyte-81ab969f-8e1a-4959-a231-0ceb7f236104" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-81ab969f-8e1a-4959-a231-0ceb7f236104" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0f8d9-716e-4e66-9f39-02e4eaf58c63]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:21 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 Jul 11 03:54:21 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:21 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 1073741824" returned: 0 in 0.854s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:21 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:21 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:22 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104" returned: 0 in 0.803s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:22 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104 Jul 11 03:54:22 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:22 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.671s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3e868f-1e32-4559-a568-24a1a109214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4a48f6-d4f0-4bb6-ad9f-ed89e32155c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:22 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Volume volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 (a60c7bfe-05b8-447c-be0d-a52ea8e4be20): created successfully Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4a48f6-d4f0-4bb6-ad9f-ed89e32155c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (6e3613d9-1a4d-4b0a-a4c6-435fb115a03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:22 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-37f2fc83-c754-471b-a688-4c8b733f5b94 tempest-GroupSnapshotsTest-2053328560 None] Created volume successfully. Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[58948d46-de68-413b-a718-c2e5888fcdee]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:22 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 Jul 11 03:54:22 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:22 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] GroupSnapshot 48268b01-a191-48d6-9c2c-5b883b18c656: creating. Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Group snapshot 48268b01-a191-48d6-9c2c-5b883b18c656: creating. {{(pid=87437) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:22 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-81ab969f-8e1a-4959-a231-0ceb7f236104" returned: 0 in 0.723s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-81ab969f-8e1a-4959-a231-0ceb7f236104" released by "delete_volume" :: held 1.565s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Created reservations ['eb7dd89b-426c-440c-84a3-565ad772841a', '6ecc973f-b843-49fd-8edc-55552a8e8788', 'cdf51db3-4577-44c0-a503-ce8a8057580d', '3e5e65dc-8f4b-4ffb-b51c-93499febb727'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:23 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:23 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:23 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11" returned: 0 in 0.817s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.516s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Creating offline snapshot 4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 of volume a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5ff639-16fe-4b45-88a5-c4b4985ec66e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-04da865e-bb71-4cea-9ce6-bfaa35224f11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c70293cf-aee2-4e01-9cad-741d4a3a8c2d', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 03:54:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-1d322792-4618-4805-8007-79993ada19be req-f7fb6e1f-b45e-465c-9256-7b0dce30efdd tempest-TaggedAttachmentsTest-672762497 None] attachment_update completed successfully. Jul 11 03:54:23 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:23 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:23 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.763s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Deleted volume successfully. Jul 11 03:54:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4efb75df-9a9f-4aa6-b4e7-cae78288a33a tempest-VolumesActionsTest-1310083591 None] Lock "cinder-81ab969f-8e1a-4959-a231-0ceb7f236104-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (c7825a86-7968-4c6f-b16d-7e9247d45159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763ddb43-d826-4083-a2d7-92c6e18c7768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763ddb43-d826-4083-a2d7-92c6e18c7768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-333998833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa1f8f5-1f78-463a-a612-da17dc3ed685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:24Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2513ac-39a0-4e7d-8325-6457cb5db5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2513ac-39a0-4e7d-8325-6457cb5db5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dbb7c4-e244-46c4-9794-2c5fd6051b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dbb7c4-e244-46c4-9794-2c5fd6051b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa1f8f5-1f78-463a-a612-da17dc3ed685', 'volume_name': 'volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b32299-6ff0-4fcf-b8bf-8124fc19f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b32299-6ff0-4fcf-b8bf-8124fc19f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e3c441-7350-4dde-9320-25230f023da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:24 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Volume 5fa1f8f5-1f78-463a-a612-da17dc3ed685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685', 'volume_size': 1} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:24 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.871s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:24 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 1G Jul 11 03:54:24 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:25 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 1G" returned: 0 in 0.803s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:25 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 Jul 11 03:54:25 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:25 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" returned: 0 in 0.676s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:25 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:54:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:25 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 Jul 11 03:54:25 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:26 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" returned: 0 in 0.648s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:26 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info Jul 11 03:54:26 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:27 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info" returned: 0 in 0.640s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:27 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:27 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info Jul 11 03:54:27 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:27 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.info" returned: 0 in 0.641s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-333998833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa1f8f5-1f78-463a-a612-da17dc3ed685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:24Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Creating volume 5fa1f8f5-1f78-463a-a612-da17dc3ed685 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:27 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:27 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 1073741824 Jul 11 03:54:27 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-08c962a1-417e-440b-8629-eccfb5a2cbb7 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 48268b01-a191-48d6-9c2c-5b883b18c656: created successfully Jul 11 03:54:28 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 1073741824" returned: 0 in 0.850s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:28 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 Jul 11 03:54:28 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:29 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685" returned: 0 in 0.640s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e3c441-7350-4dde-9320-25230f023da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a9ee8d-68c7-4d03-81f4-1c73fe47590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:29 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Volume volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 (5fa1f8f5-1f78-463a-a612-da17dc3ed685): created successfully Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a9ee8d-68c7-4d03-81f4-1c73fe47590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (c7825a86-7968-4c6f-b16d-7e9247d45159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-bfeb3f9c-b592-4643-b4b0-1400e94b485a tempest-VolumesActionsTest-905746502 None] Created volume successfully. Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Creating volume b0a70d1b-9cf1-4f67-a089-d1735ab8e472 from snapshot 4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] snapshot: 4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1, volume: b0a70d1b-9cf1-4f67-a089-d1735ab8e472, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6913b0c-8e40-4c24-aeee-6a12f7484f7f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:29 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 Jul 11 03:54:29 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-5fa1f8f5-1f78-463a-a612-da17dc3ed685-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Lock "cinder-5fa1f8f5-1f78-463a-a612-da17dc3ed685-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-e9a098e1-0964-4dc6-83c5-1e6ccd9e8642 req-401650fe-e916-4cea-a0ba-14f611e85548 tempest-TaggedAttachmentsTest-672762497 None] Terminate volume connection completed successfully. Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-e9a098e1-0964-4dc6-83c5-1e6ccd9e8642 req-401650fe-e916-4cea-a0ba-14f611e85548 tempest-TaggedAttachmentsTest-672762497 None] Deleting attachment c70293cf-aee2-4e01-9cad-741d4a3a8c2d. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 03:54:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-quobyte-5fa1f8f5-1f78-463a-a612-da17dc3ed685" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-5fa1f8f5-1f78-463a-a612-da17dc3ed685" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede72574-1ec5-4d74-8013-2b091964ae7b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:30 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 Jul 11 03:54:30 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:30 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" returned: 0 in 0.926s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c46c232-241f-4828-a3f9-2cb15501f256]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:30 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:30 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:30 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685" returned: 0 in 0.822s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:30 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685 Jul 11 03:54:30 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:31 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.939s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:31 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 Jul 11 03:54:31 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:31 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5fa1f8f5-1f78-463a-a612-da17dc3ed685" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-5fa1f8f5-1f78-463a-a612-da17dc3ed685" released by "delete_volume" :: held 1.599s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Created reservations ['f973a541-700a-4d85-a67d-7d7eda179e43', 'a7423620-b589-428e-9532-c4f2d5657135', 'e67ee1a3-b771-49a1-85ec-c213523506f8', '55b456c9-faa3-46ff-b198-e31a5e289b1a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:31 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:31 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:32 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.186s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:32 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Deleted volume successfully. Jul 11 03:54:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-08c2f557-afff-4cc1-a179-de8da559637c tempest-VolumesActionsTest-1310083591 None] Lock "cinder-5fa1f8f5-1f78-463a-a612-da17dc3ed685-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (4abe78c2-8ceb-43e1-aea5-bb3cc2f13ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd20b329-cd3f-4645-b18f-ee75c9b5c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd20b329-cd3f-4645-b18f-ee75c9b5c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772209263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd00cca-1aeb-4d09-af45-f8dfb7f3e410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:34Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ae5533-ce78-4735-8917-c42eaa9682a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ae5533-ce78-4735-8917-c42eaa9682a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7291bf-1e12-4a6d-a3dd-c8d2d843a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7291bf-1e12-4a6d-a3dd-c8d2d843a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd00cca-1aeb-4d09-af45-f8dfb7f3e410', 'volume_name': 'volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607bbcb5-83ed-41fc-a956-c3a4df86c557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607bbcb5-83ed-41fc-a956-c3a4df86c557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140038b4-c7df-44c7-8434-ff76d85ec37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:34 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Volume fdd00cca-1aeb-4d09-af45-f8dfb7f3e410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410', 'volume_size': 1} Jul 11 03:54:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:37 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" returned: 0 in 6.486s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:37 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a045d25-de5d-40cb-9cd7-b26a9642516b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:38 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:38 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:38 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.929s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:38 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:54:38 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Converted 1024.00 MB image at 157.84 MB/s Jul 11 03:54:38 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:54:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:38 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 Jul 11 03:54:38 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:39 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" returned: 0 in 0.681s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" released by "_copy_volume_from_snapshot" :: held 10.107s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" released by "_create_volume_from_snapshot" :: held 10.141s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.163s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772209263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd00cca-1aeb-4d09-af45-f8dfb7f3e410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:34Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Creating volume fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:39 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:39 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 1073741824 Jul 11 03:54:39 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:39 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c775156d-bb3f-4036-b8fd-7e390b7cb69e tempest-GroupSnapshotsTest-2053328560 None] Create group from source-snapshot-48268b01-a191-48d6-9c2c-5b883b18c656 completed successfully. Jul 11 03:54:40 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 1073741824" returned: 0 in 0.906s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:40 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 Jul 11 03:54:40 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98f0c4-f7ea-4277-9cd8-140e84124763]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:40 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 Jul 11 03:54:40 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:41 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410" returned: 0 in 0.703s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140038b4-c7df-44c7-8434-ff76d85ec37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c88fb80-86a7-4259-8fc3-504ee1e8527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:41 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Volume volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 (fdd00cca-1aeb-4d09-af45-f8dfb7f3e410): created successfully Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c88fb80-86a7-4259-8fc3-504ee1e8527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (4abe78c2-8ceb-43e1-aea5-bb3cc2f13ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-bab0472e-a790-4158-b4c9-80e7b0688ccc tempest-VolumesActionsTest-905746502 None] Created volume successfully. Jul 11 03:54:41 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" returned: 0 in 0.840s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:41 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472 Jul 11 03:54:41 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-quobyte-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf66964-cbdd-498e-9975-a580ac66a81e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:42 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 Jul 11 03:54:42 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:42 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" returned: 0 in 0.881s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-b0a70d1b-9cf1-4f67-a089-d1735ab8e472" released by "delete_volume" :: held 1.776s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['ab42382a-59be-49b7-ac52-74d341dbc964'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:42 devstack cinder-volume[87437]: WARNING cinder.quota [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-226677890 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-226677890, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:54:42 devstack cinder-volume[87437]: WARNING cinder.quota [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-226677890 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-226677890, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['790a51dc-350f-4ed8-91fc-a4c3525e8e1f', '4c0d9774-499e-4467-91fa-a1bdc39b72aa', '1589a757-373d-4c64-a745-9bbc516a93b1', '2212e02c-52b5-4cc6-acda-c248ecaf2708'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:42 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:42 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:42 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410" returned: 0 in 1.109s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:43 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410 Jul 11 03:54:43 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 48268b01-a191-48d6-9c2c-5b883b18c656: deleting Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 48268b01-a191-48d6-9c2c-5b883b18c656: deleting {{(pid=87437) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Deleting offline snapshot 4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 of volume a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] snapshot_file for this snap is: volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e065c3-11c3-41a3-bb5a-da0d948ece9e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:43 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.877s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-84d64668-332d-4ba4-b8c5-51882e1fce98 tempest-GroupSnapshotsTest-2053328560 None] Delete group completed successfully. Jul 11 03:54:43 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 Jul 11 03:54:43 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:43 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410" returned: 0 in 0.998s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410" released by "delete_volume" :: held 2.157s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Created reservations ['8fed6dd7-c3a5-4622-9b6b-1994a93ba1fd', '6151a1db-2260-4e9b-84b1-0705fc99b631', 'd0f43c6b-dd83-4064-bcf3-71963fbd10b6', 'db54c9be-272f-4029-bedb-4f36c27018d3'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:44 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:44 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:44 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" returned: 0 in 0.922s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[527c8ed3-c169-4a30-9a44-78fcfc81301f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:44 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:44 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:44 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Deleted volume successfully. Jul 11 03:54:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-570e2b66-906a-48a6-b791-69be52864b64 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-fdd00cca-1aeb-4d09-af45-f8dfb7f3e410-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:45 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.798s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:45 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 Jul 11 03:54:45 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (992a965c-501b-4240-9307-290ec0e5e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5756c2b-8d03-4963-b215-5178f71fcd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5756c2b-8d03-4963-b215-5178f71fcd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152673419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:46Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848e810b-2a61-4f63-b133-ffe4b4fdd399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848e810b-2a61-4f63-b133-ffe4b4fdd399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14363e1a-1658-442c-b4bd-d059df7d3802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14363e1a-1658-442c-b4bd-d059df7d3802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366', 'volume_name': 'volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a10ce2-e15e-4b64-a533-f15665919343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a10ce2-e15e-4b64-a533-f15665919343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a9cd8d-f97e-4431-b274-58812efbce62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Volume 46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366', 'volume_size': 1} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-152673419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:46Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Creating volume 46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:45 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:45 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 1073741824 Jul 11 03:54:45 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:46 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" returned: 0 in 0.860s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:46 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1 Jul 11 03:54:46 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:46 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 1073741824" returned: 0 in 0.816s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=90,cinder:INSERT=21,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=73,cinder:UPDATE=91,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:46 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 Jul 11 03:54:46 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:46 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20.4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" returned: 0 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-4b051bc2-2d0d-4bdd-8b9d-1b7d8610aab1" released by "_delete_snapshot" :: held 3.472s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" released by "delete_snapshot" :: held 3.507s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:47 devstack cinder-volume[87437]: WARNING cinder.quota [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-226677890 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-226677890, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['6ebeeda7-5c78-4311-8372-d0a9e46a660f', '594861e6-c3f9-4b01-bb09-0b7e3493aa6a', '019f9b31-e609-4563-960f-117e980c8f02', '762a411a-bb16-4233-af42-8f97ad55fc03'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ddf12fdf-447d-46f6-a352-4d0ec1b295c4 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 48268b01-a191-48d6-9c2c-5b883b18c656: deleted successfully Jul 11 03:54:47 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366" returned: 0 in 0.704s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a9cd8d-f97e-4431-b274-58812efbce62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3a1f89-4511-4c25-b461-3717e1c22f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:47 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Volume volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 (46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366): created successfully Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3a1f89-4511-4c25-b461-3717e1c22f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (992a965c-501b-4240-9307-290ec0e5e408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-94e4d493-983a-4e4a-a3dd-b44d8eb40dc6 tempest-VolumesActionsTest-905746502 None] Created volume successfully. Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "cinder-quobyte-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b07c75-8a04-4566-abe0-b172db600e66]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:48 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 Jul 11 03:54:48 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2eea1b-c1ce-42d2-8c04-a62a6115556d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:48 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:48 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:48 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366" returned: 0 in 0.894s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:48 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366 Jul 11 03:54:48 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:49 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.848s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:49 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20 Jul 11 03:54:49 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:49 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366" returned: 0 in 0.736s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-quobyte-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366" released by "delete_volume" :: held 1.683s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Created reservations ['85aee90e-3d94-41f3-8d31-97f814609287', 'e577afad-053b-430c-b05f-d4c967d25532', 'a9428896-d294-4095-b5d6-d137ae9978fa', 'fb8e1816-cd53-4553-9ea9-d274d78f467f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:49 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" returned: 0 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-a60c7bfe-05b8-447c-be0d-a52ea8e4be20" released by "delete_volume" :: held 1.669s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:49 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:49 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:49 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['f6be737b-d896-439b-8d25-df98cbcbd1b9'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:50 devstack cinder-volume[87437]: WARNING cinder.db.api [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-226677890'] Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['9dca30d7-1255-469c-a4fa-4f8d369c35e1', '537226b7-87d8-45a8-a28d-bd04d4cdd6f2', '9faee230-45ff-4593-b020-969c0668f9a9', '7960dfb1-88c9-4320-809e-91708e98824b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Acquiring lock "cinder-04da865e-bb71-4cea-9ce6-bfaa35224f11-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Lock "cinder-04da865e-bb71-4cea-9ce6-bfaa35224f11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:50 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:50 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Acquiring lock "cinder-quobyte-04da865e-bb71-4cea-9ce6-bfaa35224f11" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Lock "cinder-quobyte-04da865e-bb71-4cea-9ce6-bfaa35224f11" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8592cf0-165c-44ed-a954-10dd3da2d84f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:50 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 Jul 11 03:54:50 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:50 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (46b521e1-781f-4646-86a4-e19298525c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbe0e4d-4961-430c-b252-37fb05fa58c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.047s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Deleted volume successfully. Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbe0e4d-4961-430c-b252-37fb05fa58c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814788973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b525d-82f7-467e-99b2-6ab3312888e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:51Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0a6cb0-f9ca-4029-8e66-127b096ca98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0a6cb0-f9ca-4029-8e66-127b096ca98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d48ac7-e063-438a-bfdc-9ab1c39c27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d48ac7-e063-438a-bfdc-9ab1c39c27b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045b525d-82f7-467e-99b2-6ab3312888e2', 'volume_name': 'volume-045b525d-82f7-467e-99b2-6ab3312888e2', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfb451d-3f97-452f-8c7f-7a39e2b19380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfb451d-3f97-452f-8c7f-7a39e2b19380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b262ad-0de0-4e0c-9818-a399ac3de6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Volume 045b525d-82f7-467e-99b2-6ab3312888e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045b525d-82f7-467e-99b2-6ab3312888e2', 'volume_size': 1} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814788973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045b525d-82f7-467e-99b2-6ab3312888e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaeb3d30e1c944489a2938b0a0fc9641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:51Z,use_quota=True,user_id='6d11fe6cc778463580c208c822fc6315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Creating volume 045b525d-82f7-467e-99b2-6ab3312888e2 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:50 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-20fa813d-4a1e-452b-8f05-da19687796f2 tempest-VolumesActionsTest-1310083591 None] Lock "cinder-46cd1ea1-6ca8-41a7-8eb0-3b09b9a08366-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:51 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:51 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 1073741824 Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.884s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:51 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-eb001976-58aa-41c6-9aef-8a634a09c32e tempest-GroupSnapshotsTest-2053328560 None] Delete group completed successfully. Jul 11 03:54:51 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-83c8484a-01ea-4aa0-976b-7dfa72772bbf tempest-GroupSnapshotsTest-2053328560 None] Group tempest-GroupSnapshotsTest-Group-1260182241: creating Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11" returned: 0 in 0.987s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:51 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11 Jul 11 03:54:51 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-83c8484a-01ea-4aa0-976b-7dfa72772bbf tempest-GroupSnapshotsTest-2053328560 None] Group tempest-GroupSnapshotsTest-Group-1260182241: created successfully Jul 11 03:54:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-83c8484a-01ea-4aa0-976b-7dfa72772bbf tempest-GroupSnapshotsTest-2053328560 None] Create group completed successfully. Jul 11 03:54:51 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 1073741824" returned: 0 in 0.911s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:51 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-04da865e-bb71-4cea-9ce6-bfaa35224f11" returned: 0 in 0.673s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:51 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 Jul 11 03:54:51 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Lock "cinder-quobyte-04da865e-bb71-4cea-9ce6-bfaa35224f11" released by "delete_volume" :: held 1.714s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Created reservations ['5e1bfedc-de50-4347-b502-c0304246b23d', '0a12fca3-1f56-4721-8cd0-9089173f0f2e', '45dafa27-2007-4a8a-8533-36d32315ff65', '46829ca1-6199-4eab-b424-e3c3165e06ac'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:52 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:52 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:52 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b262ad-0de0-4e0c-9818-a399ac3de6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045b525d-82f7-467e-99b2-6ab3312888e2', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e864f21f-8beb-4199-ae32-06e24621f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:52 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Volume volume-045b525d-82f7-467e-99b2-6ab3312888e2 (045b525d-82f7-467e-99b2-6ab3312888e2): created successfully Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e864f21f-8beb-4199-ae32-06e24621f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Flow 'volume_create_manager' (46b521e1-781f-4646-86a4-e19298525c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2d9bd9db-c742-49b6-aac8-383cb3cc5588 tempest-VolumesActionsTest-905746502 None] Created volume successfully. Jul 11 03:54:52 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.830s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Deleted volume successfully. Jul 11 03:54:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-100f4dc5-bba5-4733-9591-52f0e578b768 tempest-TaggedAttachmentsTest-672762497 None] Lock "cinder-04da865e-bb71-4cea-9ce6-bfaa35224f11-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (b86bc216-2f1d-4faf-8f05-0e280e82e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7dea29-5cb2-4beb-a887-81d8772cf569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7dea29-5cb2-4beb-a887-81d8772cf569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2090149341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1093fdfb-32ec-45ae-b07e-8e9be3a1f28a,host='devstack@QuobyteHD#QuobyteHD',id=c1b8f59b-8434-4208-83ea-e165050fd452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:53Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(446234d9-c48e-4d1f-9e37-9551f6874aaa),volume_type_id=446234d9-c48e-4d1f-9e37-9551f6874aaa)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc056a98-76c7-497f-b927-c4c4be070142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc056a98-76c7-497f-b927-c4c4be070142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb341f4-889b-401e-adb8-e93b5331dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb341f4-889b-401e-adb8-e93b5331dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b8f59b-8434-4208-83ea-e165050fd452', 'volume_name': 'volume-c1b8f59b-8434-4208-83ea-e165050fd452', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb94f03-860e-46ab-89c5-cfc0608e6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb94f03-860e-46ab-89c5-cfc0608e6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151bb0b4-c3c7-416d-b604-9e6ad76f21ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:53 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Volume c1b8f59b-8434-4208-83ea-e165050fd452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b8f59b-8434-4208-83ea-e165050fd452', 'volume_size': 1} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1093fdfb-32ec-45ae-b07e-8e9be3a1f28a,created_at=2026-07-11T01:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2090149341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1093fdfb-32ec-45ae-b07e-8e9be3a1f28a,host='devstack@QuobyteHD#QuobyteHD',id=c1b8f59b-8434-4208-83ea-e165050fd452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:53Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(446234d9-c48e-4d1f-9e37-9551f6874aaa),volume_type_id=446234d9-c48e-4d1f-9e37-9551f6874aaa)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Creating volume c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:53 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:53 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 1073741824 Jul 11 03:54:53 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Acquiring lock "cinder-045b525d-82f7-467e-99b2-6ab3312888e2-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Lock "cinder-045b525d-82f7-467e-99b2-6ab3312888e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Acquiring lock "cinder-quobyte-045b525d-82f7-467e-99b2-6ab3312888e2" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Lock "cinder-quobyte-045b525d-82f7-467e-99b2-6ab3312888e2" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c83e6-c28f-4b22-bc6f-7f6f2e05e1b6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:54:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:53 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 Jul 11 03:54:53 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:54 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 1073741824" returned: 0 in 0.996s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:54 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 Jul 11 03:54:54 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:54 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2" returned: 0 in 0.875s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:54 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2 Jul 11 03:54:54 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:54 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151bb0b4-c3c7-416d-b604-9e6ad76f21ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b8f59b-8434-4208-83ea-e165050fd452', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2602e348-20ef-4fec-abaf-46b702db12d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:54 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Volume volume-c1b8f59b-8434-4208-83ea-e165050fd452 (c1b8f59b-8434-4208-83ea-e165050fd452): created successfully Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2602e348-20ef-4fec-abaf-46b702db12d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (b86bc216-2f1d-4faf-8f05-0e280e82e483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:54 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c9e43817-2ae1-43df-bf20-5aadbfcb1441 tempest-GroupSnapshotsTest-2053328560 None] Created volume successfully. Jul 11 03:54:55 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-045b525d-82f7-467e-99b2-6ab3312888e2" returned: 0 in 0.710s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Lock "cinder-quobyte-045b525d-82f7-467e-99b2-6ab3312888e2" released by "delete_volume" :: held 1.643s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Created reservations ['a12926cf-113c-4934-a98e-f1ea8506f40d', '3ff8d145-c8d9-446b-a22f-cc85e4b5f7df', '67cb6d8b-d7ca-4899-aab6-33356a1bf9c7', '8119fddb-02a2-49db-8ed3-b66be00c1508'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:55 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:54:55 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (2fb97975-18b2-4029-a081-eb356bb0a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7645419e-753b-4366-b3e9-ca6b8ece839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7645419e-753b-4366-b3e9-ca6b8ece839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026715444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1093fdfb-32ec-45ae-b07e-8e9be3a1f28a,host='devstack@QuobyteHD#QuobyteHD',id=aa221dbb-bbf7-41b3-b42d-3eee981ab90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:56Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(446234d9-c48e-4d1f-9e37-9551f6874aaa),volume_type_id=446234d9-c48e-4d1f-9e37-9551f6874aaa)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d65d5e9-e9ea-4012-a8b0-273453e97195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d65d5e9-e9ea-4012-a8b0-273453e97195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e02f45a-b07f-4ae6-849b-456f4162911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e02f45a-b07f-4ae6-849b-456f4162911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa221dbb-bbf7-41b3-b42d-3eee981ab90a', 'volume_name': 'volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3e6c37-e04f-4af8-aefc-837e41b1bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3e6c37-e04f-4af8-aefc-837e41b1bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd44c3d-54fe-4052-9302-82db86d95ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Volume aa221dbb-bbf7-41b3-b42d-3eee981ab90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a', 'volume_size': 1} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1093fdfb-32ec-45ae-b07e-8e9be3a1f28a,created_at=2026-07-11T01:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2026715444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1093fdfb-32ec-45ae-b07e-8e9be3a1f28a,host='devstack@QuobyteHD#QuobyteHD',id=aa221dbb-bbf7-41b3-b42d-3eee981ab90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:54:56Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(446234d9-c48e-4d1f-9e37-9551f6874aaa),volume_type_id=446234d9-c48e-4d1f-9e37-9551f6874aaa)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Creating volume aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:54:56 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:56 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.828s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:54:56 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a 1073741824 Jul 11 03:54:56 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Deleted volume successfully. Jul 11 03:54:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-db41e7c0-bfc7-4597-bebd-a9adfc4d6f13 tempest-VolumesActionsTest-905746502 None] Lock "cinder-045b525d-82f7-467e-99b2-6ab3312888e2-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:54:57 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a 1073741824" returned: 0 in 1.074s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:54:57 devstack sudo[91974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a Jul 11 03:54:57 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:54:58 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" returned: 0 in 0.710s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd44c3d-54fe-4052-9302-82db86d95ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b90433-64bd-4666-8c62-7f92732658bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:54:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Volume volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a (aa221dbb-bbf7-41b3-b42d-3eee981ab90a): created successfully Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b90433-64bd-4666-8c62-7f92732658bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:54:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (2fb97975-18b2-4029-a081-eb356bb0a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:54:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-16fe22f4-efee-4985-ad36-20401da7bb3a tempest-GroupSnapshotsTest-2053328560 None] Created volume successfully. Jul 11 03:54:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4f011bce-a253-4f0b-ac37-3ee62a474a33 tempest-GroupSnapshotsTest-2053328560 None] Update group completed successfully. Jul 11 03:55:00 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1075ec55-261b-4015-8afe-edec84eba75a tempest-GroupSnapshotsTest-2053328560 None] Update group completed successfully. Jul 11 03:55:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-088e8e51-5dba-44ab-9144-3117ccf01bfe tempest-GroupSnapshotsTest-2053328560 None] Update group completed successfully. Jul 11 03:55:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-deddca87-2cc2-4ec4-96e1-dce981e1cba9 tempest-GroupSnapshotsTest-2053328560 None] Update group completed successfully. Jul 11 03:55:04 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] GroupSnapshot 95d76056-5bb9-4225-815b-fac24ffc37f3: creating. Jul 11 03:55:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Group snapshot 95d76056-5bb9-4225-815b-fac24ffc37f3: creating. {{(pid=87437) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 03:55:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Creating offline snapshot 70003e6b-daa1-4dc6-a86d-ac43a206b8a9 of volume c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:55:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46358cc-e2b8-4502-9d55-0cf3e0e33ae2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:04 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 Jul 11 03:55:04 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:05 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452" returned: 0 in 0.914s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:05 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 1G Jul 11 03:55:05 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:06 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 1G" returned: 0 in 0.979s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8f59b-8434-4208-83ea-e165050fd452 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:06 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8f59b-8434-4208-83ea-e165050fd452 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 Jul 11 03:55:06 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:06 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8f59b-8434-4208-83ea-e165050fd452 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9" returned: 0 in 0.766s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:06 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:55:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:06 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 Jul 11 03:55:06 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:07 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9" returned: 0 in 0.737s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:07 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info Jul 11 03:55:07 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Flow 'volume_create_manager' (a7f6ee7e-abef-4730-95b9-b014d43ff760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44688a-b7d6-4d60-84c8-01dffc1b4b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44688a-b7d6-4d60-84c8-01dffc1b4b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1322213937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e068ae4a-710b-4670-84bb-7b71c187354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fe627f0ad242a08025f5f264074ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:08Z,use_quota=True,user_id='428d3c4cc7b4456aa6722dec6932b540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feff3613-134c-405b-a756-5118275ae094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feff3613-134c-405b-a756-5118275ae094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f183a1-5cf6-4db3-99f4-9f600e79dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f183a1-5cf6-4db3-99f4-9f600e79dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e068ae4a-710b-4670-84bb-7b71c187354e', 'volume_name': 'volume-e068ae4a-710b-4670-84bb-7b71c187354e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30caad6f-429d-45c1-8b0e-05c9562404de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30caad6f-429d-45c1-8b0e-05c9562404de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce365c-0dae-4dfa-86aa-d12f5bb0672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:08 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Volume e068ae4a-710b-4670-84bb-7b71c187354e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e068ae4a-710b-4670-84bb-7b71c187354e', 'volume_size': 1} Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:08 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info" returned: 0 in 0.782s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:08 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:55:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:08 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info Jul 11 03:55:08 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:09 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.info" returned: 0 in 0.793s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.094s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Creating offline snapshot e22b0dca-acdc-4027-b60a-2bee6c28394b of volume aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[00acd936-53fb-4392-a8d6-d5addd8eec96]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:09 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a Jul 11 03:55:09 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:10 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" returned: 0 in 0.877s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:10 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b 1G Jul 11 03:55:10 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:11 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b 1G" returned: 0 in 0.986s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:11 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b Jul 11 03:55:11 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:11 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b" returned: 0 in 0.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:11 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:55:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:12 devstack sudo[92369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b Jul 11 03:55:12 devstack sudo[92369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:12 devstack sudo[92369]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b" returned: 0 in 0.835s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:12 devstack sudo[92372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info Jul 11 03:55:12 devstack sudo[92372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:13 devstack sudo[92372]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:13 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:55:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:13 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info Jul 11 03:55:13 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:14 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:55:14 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:14 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.info" returned: 0 in 0.702s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.965s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.065s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1322213937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e068ae4a-710b-4670-84bb-7b71c187354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fe627f0ad242a08025f5f264074ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:08Z,use_quota=True,user_id='428d3c4cc7b4456aa6722dec6932b540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Creating volume e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:55:14 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:14 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e 1073741824 Jul 11 03:55:14 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-07ab0ea0-507d-4745-95f7-b59f732e3e61 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 95d76056-5bb9-4225-815b-fac24ffc37f3: created successfully Jul 11 03:55:14 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 8 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:55:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 95d76056-5bb9-4225-815b-fac24ffc37f3: deleting Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 95d76056-5bb9-4225-815b-fac24ffc37f3: deleting {{(pid=87437) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-c1b8f59b-8434-4208-83ea-e165050fd452" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-c1b8f59b-8434-4208-83ea-e165050fd452" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-70003e6b-daa1-4dc6-a86d-ac43a206b8a9" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-70003e6b-daa1-4dc6-a86d-ac43a206b8a9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Deleting offline snapshot 70003e6b-daa1-4dc6-a86d-ac43a206b8a9 of volume c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] snapshot_file for this snap is: volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d7985-5397-42c8-9d42-f7e3cd545a83]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:15 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 Jul 11 03:55:15 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:15 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e 1073741824" returned: 0 in 1.045s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:15 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e Jul 11 03:55:15 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:15 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9" returned: 0 in 0.902s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b8f59b-8434-4208-83ea-e165050fd452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350d8e3-f932-4ef7-a73e-bf614de1d0c8]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:16 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 Jul 11 03:55:16 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:16 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce365c-0dae-4dfa-86aa-d12f5bb0672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e068ae4a-710b-4670-84bb-7b71c187354e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41776b0b-8fee-4c88-8259-6a467072901b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:16 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Volume volume-e068ae4a-710b-4670-84bb-7b71c187354e (e068ae4a-710b-4670-84bb-7b71c187354e): created successfully Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41776b0b-8fee-4c88-8259-6a467072901b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Flow 'volume_create_manager' (a7f6ee7e-abef-4730-95b9-b014d43ff760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-17536944-d31f-42e3-af4a-08784779b218 tempest-SnapshotMetadataTestJSON-1397344003 None] Created volume successfully. Jul 11 03:55:16 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452" returned: 0 in 0.836s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:16 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 Jul 11 03:55:16 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Creating offline snapshot f504965c-92e2-471f-82ab-7fb66e93d2b5 of volume e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f3859-79f5-406a-ab03-299c337b087a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:17 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e Jul 11 03:55:17 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:17 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9" returned: 0 in 0.781s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:17 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9 Jul 11 03:55:17 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:17 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e" returned: 0 in 0.823s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:17 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 1G Jul 11 03:55:17 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:18 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452.70003e6b-daa1-4dc6-a86d-ac43a206b8a9" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-70003e6b-daa1-4dc6-a86d-ac43a206b8a9" released by "_delete_snapshot" :: held 3.353s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-c1b8f59b-8434-4208-83ea-e165050fd452" released by "delete_snapshot" :: held 3.388s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-e22b0dca-acdc-4027-b60a-2bee6c28394b" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-e22b0dca-acdc-4027-b60a-2bee6c28394b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Deleting offline snapshot e22b0dca-acdc-4027-b60a-2bee6c28394b of volume aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] snapshot_file for this snap is: volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d661732-a61c-40dc-bf37-840a20947e79]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:18 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b Jul 11 03:55:18 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:18 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 1G" returned: 0 in 0.870s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e068ae4a-710b-4670-84bb-7b71c187354e -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:18 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e068ae4a-710b-4670-84bb-7b71c187354e -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 Jul 11 03:55:18 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:19 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b" returned: 0 in 0.832s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:55:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1556e125-35a6-467a-ab31-f5a0d3f2e2a9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:19 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a Jul 11 03:55:19 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:19 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e068ae4a-710b-4670-84bb-7b71c187354e -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5" returned: 0 in 0.724s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:19 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 is being set with open permissions: ugo+rw Jul 11 03:55:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:19 devstack sudo[92435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 Jul 11 03:55:19 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:20 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" returned: 0 in 0.780s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:20 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b Jul 11 03:55:20 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:20 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:20 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info Jul 11 03:55:20 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:20 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:20 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b Jul 11 03:55:20 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:20 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info" returned: 0 in 0.691s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:20 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info is being set with open permissions: ugo+rw Jul 11 03:55:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:20 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info Jul 11 03:55:20 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:21 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a.e22b0dca-acdc-4027-b60a-2bee6c28394b" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-e22b0dca-acdc-4027-b60a-2bee6c28394b" released by "_delete_snapshot" :: held 3.155s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" released by "delete_snapshot" :: held 3.181s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:21 devstack cinder-volume[87437]: WARNING cinder.quota [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1798741946 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1798741946, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:55:21 devstack cinder-volume[87437]: WARNING cinder.quota [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1798741946 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1798741946, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['1f0f66c3-6139-47ea-8fe8-d510fa1436b6', '03db18d4-72de-4b25-b040-549a9c69274c', 'fc1cf742-88be-4dde-8642-2e6b6d0928ae', '7c8dad54-cc20-412f-8b49-3bc7e57a6a9b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:21 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.info" returned: 0 in 0.776s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.673s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0af3f347-a965-46e5-949b-63af2f707bdf tempest-SnapshotMetadataTestJSON-1397344003 None] Create snapshot completed successfully Jul 11 03:55:21 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['88e07cb4-e553-4b38-b677-1dddd4c73030', '75911edb-1ba8-4420-aaf1-2f68c38ceaf2', 'cf929ba8-c835-4471-949c-dedebae457eb', 'e4c557fd-752e-4221-a253-c4deac9427b0'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a4e3f643-bbcf-4924-9a2f-b6e0db53c2bd tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 95d76056-5bb9-4225-815b-fac24ffc37f3: deleted successfully Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "cinder-f504965c-92e2-471f-82ab-7fb66e93d2b5-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62ced6-ab44-4c51-a877-f3f774d63c17]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-f504965c-92e2-471f-82ab-7fb66e93d2b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "cinder-quobyte-e068ae4a-710b-4670-84bb-7b71c187354e" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-quobyte-e068ae4a-710b-4670-84bb-7b71c187354e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "cinder-quobyte-f504965c-92e2-471f-82ab-7fb66e93d2b5" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-quobyte-f504965c-92e2-471f-82ab-7fb66e93d2b5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Deleting offline snapshot f504965c-92e2-471f-82ab-7fb66e93d2b5 of volume e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] snapshot_file for this snap is: volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4710f069-e814-466b-a19f-6f907a8481b9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:23 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a Jul 11 03:55:23 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:23 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 Jul 11 03:55:23 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:24 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" returned: 0 in 0.998s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:24 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a Jul 11 03:55:24 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:24 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5" returned: 0 in 1.036s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e068ae4a-710b-4670-84bb-7b71c187354e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b130ba-cabc-4b3c-900a-ca47f834c160]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:24 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e Jul 11 03:55:24 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:24 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-aa221dbb-bbf7-41b3-b42d-3eee981ab90a" released by "delete_volume" :: held 1.863s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-c1b8f59b-8434-4208-83ea-e165050fd452" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-c1b8f59b-8434-4208-83ea-e165050fd452" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:25 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7780111-8903-40c5-9397-39336dbaf33e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:25 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 Jul 11 03:55:25 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:25 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e" returned: 0 in 0.827s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:25 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 Jul 11 03:55:25 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:25 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452" returned: 0 in 0.796s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:25 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452 Jul 11 03:55:25 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:26 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5" returned: 0 in 0.888s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:26 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5 Jul 11 03:55:26 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:26 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c1b8f59b-8434-4208-83ea-e165050fd452" returned: 0 in 0.706s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-c1b8f59b-8434-4208-83ea-e165050fd452" released by "delete_volume" :: held 1.564s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['10f2323b-1843-44de-941a-30f3fdf746b4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:26 devstack cinder-volume[87437]: WARNING cinder.quota [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1798741946 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1798741946, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['4e4a99c0-57a3-4483-a997-431802d6271f', 'd63f7352-31ad-4483-a9c9-30c77bbd50fb', '2cf094b6-c310-48d9-973d-4c8fbce13508', '5552e379-1100-4f38-8dd2-3f1b0edc1744'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['a3357207-3176-49b7-8553-23e4a917df0a', '27f971dd-6526-418c-b9ec-f39730d3fa2b', 'af00b556-579f-4834-83c8-49dd63cc9bfb', '08b8de23-40ca-42f0-b2c7-f12f6954ac4e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:26 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e.f504965c-92e2-471f-82ab-7fb66e93d2b5" returned: 0 in 0.779s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:26 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:55:26 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-quobyte-f504965c-92e2-471f-82ab-7fb66e93d2b5" released by "_delete_snapshot" :: held 3.684s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-quobyte-e068ae4a-710b-4670-84bb-7b71c187354e" released by "delete_snapshot" :: held 3.716s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Created reservations ['c2065a3f-f352-4ac5-be0b-b98c99e98971', 'c23c77c6-1557-4b1b-863f-71ef35b4c5a1', '32f0501c-615f-4b6d-9cbb-a493fe6d5aef', '537d8e90-d9fd-4364-9a09-9acaaec5e717'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Delete snapshot completed successfully. Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36faba48-62d8-4f91-b67e-1a047f0e2496 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-f504965c-92e2-471f-82ab-7fb66e93d2b5-delete_snapshot" released by "delete_snapshot" :: held 3.884s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "cinder-e068ae4a-710b-4670-84bb-7b71c187354e-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-e068ae4a-710b-4670-84bb-7b71c187354e-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:27 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.836s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:55:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b50ff5d0-f795-4556-9dc0-7aee90da3f86 tempest-GroupSnapshotsTest-2053328560 None] Delete group completed successfully. Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "cinder-quobyte-e068ae4a-710b-4670-84bb-7b71c187354e" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-quobyte-e068ae4a-710b-4670-84bb-7b71c187354e" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3424bf1-c47d-490a-9aec-287e021b3977]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:28 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e Jul 11 03:55:28 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c462f846-71aa-4b7d-9d3b-b7b6f10cdeb8 tempest-GroupSnapshotsTest-2053328560 None] Group tempest-GroupSnapshotsTest-Group-27897159: creating Jul 11 03:55:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c462f846-71aa-4b7d-9d3b-b7b6f10cdeb8 tempest-GroupSnapshotsTest-2053328560 None] Group tempest-GroupSnapshotsTest-Group-27897159: created successfully Jul 11 03:55:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c462f846-71aa-4b7d-9d3b-b7b6f10cdeb8 tempest-GroupSnapshotsTest-2053328560 None] Create group completed successfully. Jul 11 03:55:28 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e" returned: 0 in 1.065s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:28 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e Jul 11 03:55:28 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:29 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e068ae4a-710b-4670-84bb-7b71c187354e" returned: 0 in 0.673s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-quobyte-e068ae4a-710b-4670-84bb-7b71c187354e" released by "delete_volume" :: held 1.849s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Created reservations ['c0df585e-6842-4f75-a372-70c219f6aa2f', '1d00f51d-a541-4467-af3e-782fe777b16d', 'e791f375-c81f-40bf-b479-e9ec93bd220b', 'ded2de50-b8aa-4aa5-b42d-8462101747d4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:29 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:55:29 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (06ce1921-e236-48e2-b28f-e092d0cdbdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72645f8f-5603-4ce6-baf2-8c36d79ec663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72645f8f-5603-4ce6-baf2-8c36d79ec663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27462271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf662b91-53f7-4b49-bf08-6cffe1f676ce,host='devstack@QuobyteHD#QuobyteHD',id=ff3a3ad8-fb7d-43fa-8c59-a547964efdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:31Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af5a544e-7fa0-4452-9355-17fe8a99ca5d),volume_type_id=af5a544e-7fa0-4452-9355-17fe8a99ca5d)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8557ccb3-646b-4779-96c9-d73425602bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8557ccb3-646b-4779-96c9-d73425602bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea05cebd-55b8-4375-9438-613d63ed4f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea05cebd-55b8-4375-9438-613d63ed4f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3a3ad8-fb7d-43fa-8c59-a547964efdbf', 'volume_name': 'volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514a0ff9-3347-4694-88f7-9161f5e344f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514a0ff9-3347-4694-88f7-9161f5e344f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2702b74e-86ae-4b78-93bd-256243c68dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:30 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Volume ff3a3ad8-fb7d-43fa-8c59-a547964efdbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf', 'volume_size': 1} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bf662b91-53f7-4b49-bf08-6cffe1f676ce,created_at=2026-07-11T01:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27462271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bf662b91-53f7-4b49-bf08-6cffe1f676ce,host='devstack@QuobyteHD#QuobyteHD',id=ff3a3ad8-fb7d-43fa-8c59-a547964efdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b0c48d43d74eea8b3667689bdc1a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:31Z,use_quota=True,user_id='ec0f8c51c26444fa9efcb40a038116bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af5a544e-7fa0-4452-9355-17fe8a99ca5d),volume_type_id=af5a544e-7fa0-4452-9355-17fe8a99ca5d)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Creating volume ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:55:30 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:30 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf 1073741824 Jul 11 03:55:30 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:30 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.219s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:30 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:55:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Deleted volume successfully. Jul 11 03:55:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-216072b2-bbf2-4d99-ae01-db4a099e0515 tempest-SnapshotMetadataTestJSON-1397344003 None] Lock "cinder-e068ae4a-710b-4670-84bb-7b71c187354e-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:32 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf 1073741824" returned: 0 in 1.445s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:32 devstack sudo[92685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf Jul 11 03:55:32 devstack sudo[92685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:32 devstack sudo[92685]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" returned: 0 in 0.758s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:55:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2702b74e-86ae-4b78-93bd-256243c68dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f493d74-7a69-4231-9894-7414bafb1218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:33 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Volume volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf (ff3a3ad8-fb7d-43fa-8c59-a547964efdbf): created successfully Jul 11 03:55:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f493d74-7a69-4231-9894-7414bafb1218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Flow 'volume_create_manager' (06ce1921-e236-48e2-b28f-e092d0cdbdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b63aae7f-ff17-4563-ba21-7c56e0a93736 tempest-GroupSnapshotsTest-2053328560 None] Created volume successfully. Jul 11 03:55:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] GroupSnapshot 50f144fb-1664-4e93-ad56-fe324856c2d2: creating. Jul 11 03:55:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Group snapshot 50f144fb-1664-4e93-ad56-fe324856c2d2: creating. {{(pid=87437) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 03:55:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Creating offline snapshot a888b025-d47b-49e7-9eb1-3907e12322e0 of volume ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:55:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b98711-c207-4cd8-8091-48570ca3ae5a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:34 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf Jul 11 03:55:34 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Flow 'volume_create_manager' (51685a82-4ab4-483e-bc01-7b8129a097da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934433dc-6fac-4051-bc27-63bdf5c32ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (934433dc-6fac-4051-bc27-63bdf5c32ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1845167328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ca3bb6-3793-4bf0-bf05-68768dc16a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2b746415fe49beb76536178eacb5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:35Z,use_quota=True,user_id='30121e718c024cfdac635afb2e3de160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa14fcba-2894-4ed0-88a0-6249646306b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa14fcba-2894-4ed0-88a0-6249646306b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd098f1-d309-4c5e-bc4b-91de0dbe28dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd098f1-d309-4c5e-bc4b-91de0dbe28dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ca3bb6-3793-4bf0-bf05-68768dc16a30', 'volume_name': 'volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd96c606-6e6c-473a-afe2-d0bfa17db000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd96c606-6e6c-473a-afe2-d0bfa17db000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9748adf6-7369-45cc-9761-23ae93901496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Volume 92ca3bb6-3793-4bf0-bf05-68768dc16a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30', 'volume_size': 1} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:35 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" returned: 0 in 1.096s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:35 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 1G Jul 11 03:55:35 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:36 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 1G" returned: 0 in 0.864s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:36 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 Jul 11 03:55:36 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:37 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0" returned: 0 in 0.741s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:37 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:55:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:37 devstack sudo[92722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 Jul 11 03:55:37 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:38 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0" returned: 0 in 0.639s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:38 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info Jul 11 03:55:38 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:38 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info" returned: 0 in 0.699s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:38 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:55:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:38 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info Jul 11 03:55:38 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:39 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.info" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.780s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.024s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1845167328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ca3bb6-3793-4bf0-bf05-68768dc16a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2b746415fe49beb76536178eacb5fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:35Z,use_quota=True,user_id='30121e718c024cfdac635afb2e3de160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Creating volume 92ca3bb6-3793-4bf0-bf05-68768dc16a30 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:55:39 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:55:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:39 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 1073741824 Jul 11 03:55:39 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:39 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8a991f5e-db0b-4621-af7b-9921313e2252 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 50f144fb-1664-4e93-ad56-fe324856c2d2: created successfully Jul 11 03:55:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 50f144fb-1664-4e93-ad56-fe324856c2d2: deleting Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 50f144fb-1664-4e93-ad56-fe324856c2d2: deleting {{(pid=87437) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-a888b025-d47b-49e7-9eb1-3907e12322e0" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-a888b025-d47b-49e7-9eb1-3907e12322e0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Deleting offline snapshot a888b025-d47b-49e7-9eb1-3907e12322e0 of volume ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] snapshot_file for this snap is: volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54af270-0038-4ad2-aa4a-77d9e7d239db]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:40 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 Jul 11 03:55:40 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:40 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 1073741824" returned: 0 in 1.058s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:40 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 Jul 11 03:55:40 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:41 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0" returned: 0 in 0.838s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49fc5b8-7f5b-406d-8fb8-a9a6fec79017]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:41 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30" returned: 0 in 0.657s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9748adf6-7369-45cc-9761-23ae93901496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:41 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf Jul 11 03:55:41 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1116bd1c-7e4c-41a8-b81f-14127f99cae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:41 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Volume volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 (92ca3bb6-3793-4bf0-bf05-68768dc16a30): created successfully Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1116bd1c-7e4c-41a8-b81f-14127f99cae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Flow 'volume_create_manager' (51685a82-4ab4-483e-bc01-7b8129a097da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4eba8620-1d46-40bb-9664-18fc7d11b049 tempest-AbsoluteLimitsTests-1048808527 None] Created volume successfully. Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Acquiring lock "cinder-92ca3bb6-3793-4bf0-bf05-68768dc16a30-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Lock "cinder-92ca3bb6-3793-4bf0-bf05-68768dc16a30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Acquiring lock "cinder-quobyte-92ca3bb6-3793-4bf0-bf05-68768dc16a30" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Lock "cinder-quobyte-92ca3bb6-3793-4bf0-bf05-68768dc16a30" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d72194d-8954-4ece-bfb3-7556ddcbf5bb]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:42 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" returned: 0 in 0.859s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:42 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 Jul 11 03:55:42 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:42 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 Jul 11 03:55:42 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:42 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0" returned: 0 in 0.798s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:42 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30" returned: 0 in 0.870s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:42 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0 Jul 11 03:55:42 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:42 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30 Jul 11 03:55:42 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:43 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf.a888b025-d47b-49e7-9eb1-3907e12322e0" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-a888b025-d47b-49e7-9eb1-3907e12322e0" released by "_delete_snapshot" :: held 3.297s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" released by "delete_snapshot" :: held 3.327s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:43 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92ca3bb6-3793-4bf0-bf05-68768dc16a30" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Lock "cinder-quobyte-92ca3bb6-3793-4bf0-bf05-68768dc16a30" released by "delete_volume" :: held 1.656s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:43 devstack cinder-volume[87437]: WARNING cinder.quota [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1342205044 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1342205044, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:55:43 devstack cinder-volume[87437]: WARNING cinder.quota [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1342205044 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1342205044, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Created reservations ['6f3bb261-fbb5-48b6-8958-c221da867670', '76cf8d1e-c4ae-4542-9330-0b8c0450b012', 'a8f0a1f0-0f7c-4306-be75-810a5925ede6', '2330a15a-293a-4155-8b1d-f9d9f7fe89f4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['be7fa028-d3aa-4cc7-9fdc-5427b40c6218', '32cc8d03-d5b1-4b39-be41-92bc9f9b83cf', 'eb6d0ea5-7978-47d9-8705-b6bca725c385', '35a5d8e6-facc-403c-a428-ef92176303f7'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:43 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:55:43 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ae2ab2ba-4ecb-485f-8971-62f818599183 tempest-GroupSnapshotsTest-2053328560 None] group_snapshot 50f144fb-1664-4e93-ad56-fe324856c2d2: deleted successfully Jul 11 03:55:44 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:44 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:55:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Deleted volume successfully. Jul 11 03:55:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-63adf76b-6ff4-4214-9c0d-f02c8043017b tempest-AbsoluteLimitsTests-1048808527 None] Lock "cinder-92ca3bb6-3793-4bf0-bf05-68768dc16a30-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "cinder-quobyte-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:55:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:55:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a4544e-f11f-4056-9030-40b53df44560]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:45 devstack sudo[92824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf Jul 11 03:55:45 devstack sudo[92824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:45 devstack sudo[92824]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" returned: 0 in 0.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:45 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf Jul 11 03:55:45 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:46 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" returned: 0 in 0.711s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Lock "cinder-quobyte-ff3a3ad8-fb7d-43fa-8c59-a547964efdbf" released by "delete_volume" :: held 1.624s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=117,cinder:INSERT=34,cinder:UPDATE=144,cinder:DELETE=5 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=122,cinder:INSERT=31,cinder:UPDATE=123,cinder:DELETE=8 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['3112c820-ac01-4882-81dd-bdf4135bba36'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:46 devstack cinder-volume[87437]: WARNING cinder.quota [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1342205044 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1342205044, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Created reservations ['6adf9ccd-9e6c-4222-b5ba-7e58ba5477a8', 'a31e5c62-bb06-468d-88a8-ace6ac6fa875', 'b6ad352b-4109-4289-834a-45673b1d33b8', '492b08f1-9074-498f-8568-8e938ef9acc6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:46 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:55:46 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:47 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.757s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:47 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:55:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-66d063fc-6c8b-4d94-be97-271615aa750c tempest-GroupSnapshotsTest-2053328560 None] Delete group completed successfully. Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Flow 'volume_create_manager' (0d19616d-b904-4583-85da-28e8246e4ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be703639-d49c-4e1c-a251-307d079d0a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be703639-d49c-4e1c-a251-307d079d0a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1798061144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3756b89a-7aed-47cc-863c-a21d81b21055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0634cdbdb4427ea928a89ac66670eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:49Z,use_quota=True,user_id='e9d1b149272d46e69525a1792d8733b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e22d371-7529-4b5f-9ccf-6ae1197a3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e22d371-7529-4b5f-9ccf-6ae1197a3a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c834bf65-3f59-4cf9-9ef6-d0b155747217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c834bf65-3f59-4cf9-9ef6-d0b155747217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3756b89a-7aed-47cc-863c-a21d81b21055', 'volume_name': 'volume-3756b89a-7aed-47cc-863c-a21d81b21055', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62b9c5e-c5e4-4943-89dc-cbc26b4f01ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62b9c5e-c5e4-4943-89dc-cbc26b4f01ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b87550c-2903-45c0-9e7d-7a2bdaea5d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:48 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Volume 3756b89a-7aed-47cc-863c-a21d81b21055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3756b89a-7aed-47cc-863c-a21d81b21055', 'volume_size': 1} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1798061144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3756b89a-7aed-47cc-863c-a21d81b21055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0634cdbdb4427ea928a89ac66670eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:49Z,use_quota=True,user_id='e9d1b149272d46e69525a1792d8733b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Creating volume 3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:55:48 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:55:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:48 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 1073741824 Jul 11 03:55:48 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:49 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 1073741824" returned: 0 in 1.058s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:49 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:55:49 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:50 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 0.706s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b87550c-2903-45c0-9e7d-7a2bdaea5d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3756b89a-7aed-47cc-863c-a21d81b21055', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc080da9-f293-4b2f-8f35-67bcc0bc77b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Volume volume-3756b89a-7aed-47cc-863c-a21d81b21055 (3756b89a-7aed-47cc-863c-a21d81b21055): created successfully Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc080da9-f293-4b2f-8f35-67bcc0bc77b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Flow 'volume_create_manager' (0d19616d-b904-4583-85da-28e8246e4ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c9771fec-d868-41be-9156-953532182307 tempest-VolumesDeleteCascade-1089790367 None] Created volume successfully. Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Creating offline snapshot 1f15eabe-429c-4ced-8f77-d473816c1819 of volume 3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6073851a-2e35-4489-9c9b-7b53e3e92c23]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:51 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:55:51 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:51 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 0.792s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:51 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 1G Jul 11 03:55:51 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:52 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 1G" returned: 0 in 0.833s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:52 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:55:52 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-36877794-3c39-4c38-bd0f-69886a84e37b tempest-GroupSnapshotsV319Test-1780373653 None] Group tempest-GroupSnapshotsV319Test-Group-1230496868: creating Jul 11 03:55:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-36877794-3c39-4c38-bd0f-69886a84e37b tempest-GroupSnapshotsV319Test-1780373653 None] Group tempest-GroupSnapshotsV319Test-Group-1230496868: created successfully Jul 11 03:55:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-36877794-3c39-4c38-bd0f-69886a84e37b tempest-GroupSnapshotsV319Test-1780373653 None] Create group completed successfully. Jul 11 03:55:53 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:53 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 is being set with open permissions: ugo+rw Jul 11 03:55:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:53 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:55:53 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:53 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.622s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:54 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info Jul 11 03:55:54 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Flow 'volume_create_manager' (d7ccb169-c277-4ed4-b035-215349806584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073ef7b1-86c3-4b7e-9d8d-c687db81c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073ef7b1-86c3-4b7e-9d8d-c687db81c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-346594850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94366526-8d71-45c9-9846-4af3e51432bd,host='devstack@QuobyteHD#QuobyteHD',id=eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7366c523956a4ebcb491090814557d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:55Z,use_quota=True,user_id='0c98906edd4740e6bc62fc1598b797d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5feb47ed-0ced-473f-894d-28a46b75ec0a),volume_type_id=5feb47ed-0ced-473f-894d-28a46b75ec0a)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0196bea7-1c46-47dd-8d17-190e17a0fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0196bea7-1c46-47dd-8d17-190e17a0fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8104a821-2251-46f8-8085-1f5315f38d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8104a821-2251-46f8-8085-1f5315f38d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba', 'volume_name': 'volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c646150-dd2b-4d16-9de7-24d711fd748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c646150-dd2b-4d16-9de7-24d711fd748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94969206-4e6d-48e9-aed2-7b188cb9f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:54 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Volume eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba', 'volume_size': 1} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:54 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:54 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info is being set with open permissions: ugo+rw Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:54 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info Jul 11 03:55:54 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Flow 'volume_create_manager' (32f04d6c-e75b-4d89-ac9c-f956aa74c982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:54 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875be19-f3a3-482f-a086-11b0c98b9fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875be19-f3a3-482f-a086-11b0c98b9fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1697957966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5b0593-c803-461b-8a07-78d6869c6fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a87c11c2d114d4ca5790139abb7acc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:55Z,use_quota=True,user_id='c5ccad8f871d44f18ad5f267c4e0d3a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99222bcd-82f1-4419-9a03-3c8c42fba545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99222bcd-82f1-4419-9a03-3c8c42fba545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31165d15-3b7a-4333-9950-d432d7e9d909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31165d15-3b7a-4333-9950-d432d7e9d909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5b0593-c803-461b-8a07-78d6869c6fa6', 'volume_name': 'volume-9c5b0593-c803-461b-8a07-78d6869c6fa6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d285daa7-27f3-4da3-ab2e-bd9e55e3d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d285daa7-27f3-4da3-ab2e-bd9e55e3d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c3e480-4642-4326-a672-99141cfa7836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Volume 9c5b0593-c803-461b-8a07-78d6869c6fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5b0593-c803-461b-8a07-78d6869c6fa6', 'volume_size': 1} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:55 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.info" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.498s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94366526-8d71-45c9-9846-4af3e51432bd,created_at=2026-07-11T01:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-346594850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94366526-8d71-45c9-9846-4af3e51432bd,host='devstack@QuobyteHD#QuobyteHD',id=eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7366c523956a4ebcb491090814557d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:55Z,use_quota=True,user_id='0c98906edd4740e6bc62fc1598b797d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5feb47ed-0ced-473f-894d-28a46b75ec0a),volume_type_id=5feb47ed-0ced-473f-894d-28a46b75ec0a)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Creating volume eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:55:55 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:55:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:55 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba 1073741824 Jul 11 03:55:55 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cb0f0902-c89a-48f5-a50e-3651102415be tempest-VolumesDeleteCascade-1089790367 None] Create snapshot completed successfully Jul 11 03:55:56 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba 1073741824" returned: 0 in 0.835s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:56 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba Jul 11 03:55:56 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:56 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" returned: 0 in 0.652s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1697957966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c5b0593-c803-461b-8a07-78d6869c6fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a87c11c2d114d4ca5790139abb7acc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:55:55Z,use_quota=True,user_id='c5ccad8f871d44f18ad5f267c4e0d3a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Creating volume 9c5b0593-c803-461b-8a07-78d6869c6fa6 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:55:57 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:57 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 1073741824 Jul 11 03:55:57 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94969206-4e6d-48e9-aed2-7b188cb9f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd848e6-688a-4d44-ae7a-c0a7c1575512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Volume volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba (eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba): created successfully Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd848e6-688a-4d44-ae7a-c0a7c1575512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Flow 'volume_create_manager' (d7ccb169-c277-4ed4-b035-215349806584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-84ed04b6-98ea-456d-85cc-d87429eefcfb tempest-GroupSnapshotsV319Test-1780373653 None] Created volume successfully. Jul 11 03:55:57 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 1073741824" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:57 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 Jul 11 03:55:57 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] GroupSnapshot 381852a1-db67-4069-8b67-a676f1b19350: creating. Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Group snapshot 381852a1-db67-4069-8b67-a676f1b19350: creating. {{(pid=87437) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:55:58 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6" returned: 0 in 0.689s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.196s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Creating offline snapshot 512ba78a-b258-495b-b11a-65f6bd7ba157 of volume 3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c3e480-4642-4326-a672-99141cfa7836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5b0593-c803-461b-8a07-78d6869c6fa6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467822f7-e97e-49b3-9976-930c31742fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f51e87-fa0d-4356-8c5c-6de6d4e54763]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Volume volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 (9c5b0593-c803-461b-8a07-78d6869c6fa6): created successfully Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467822f7-e97e-49b3-9976-930c31742fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:55:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Flow 'volume_create_manager' (32f04d6c-e75b-4d89-ac9c-f956aa74c982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:55:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a19c6529-c936-4f7a-b08e-d65518b97843 tempest-AttachVolumeShelveTestJSON-330745257 None] Created volume successfully. Jul 11 03:55:58 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:55:58 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:55:59 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 11 03:55:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.796s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:55:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3756b89a-7aed-47cc-863c-a21d81b21055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:55:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:55:59 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 1G Jul 11 03:55:59 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:00 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 1G" returned: 0 in 0.847s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:00 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 Jul 11 03:56:00 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:00 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:00 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 is being set with open permissions: ugo+rw Jul 11 03:56:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:01 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 Jul 11 03:56:01 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:01 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.204s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Creating offline snapshot 9dc3814f-1756-49ab-8e0f-cd66aac79c95 of volume eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:56:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-42bc0913-3b69-47eb-9eaf-e24d314b69c8 tempest-VolumesDeleteCascade-1089790367 None] Create snapshot completed successfully Jul 11 03:56:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[199303bc-6b70-4b14-9335-51835aff3521]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:01 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba Jul 11 03:56:01 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:02 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" returned: 0 in 0.890s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:02 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 1G Jul 11 03:56:02 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-3756b89a-7aed-47cc-863c-a21d81b21055-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-3756b89a-7aed-47cc-863c-a21d81b21055-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Performing cascade delete. {{(pid=87437) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-1f15eabe-429c-4ced-8f77-d473816c1819-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-1f15eabe-429c-4ced-8f77-d473816c1819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-1f15eabe-429c-4ced-8f77-d473816c1819" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-1f15eabe-429c-4ced-8f77-d473816c1819" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Deleting offline snapshot 1f15eabe-429c-4ced-8f77-d473816c1819 of volume 3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] snapshot_file for this snap is: volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f80a6c-1bcd-41ca-aada-a3779e5a55b6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:03 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:56:03 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:03 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 1G" returned: 0 in 0.964s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:03 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 Jul 11 03:56:03 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:03 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.847s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3756b89a-7aed-47cc-863c-a21d81b21055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94b8485-b8d3-483b-b489-85a8b66bd6f4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:03 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:56:03 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:04 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95" returned: 0 in 0.833s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:04 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:56:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:04 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 Jul 11 03:56:04 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:04 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 0.902s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d31ee2e-63cb-4df3-956e-0205864480f3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:04 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 Jul 11 03:56:04 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:05 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:05 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info Jul 11 03:56:05 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:05 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157" returned: 0 in 0.843s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3756b89a-7aed-47cc-863c-a21d81b21055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dad9e1-961f-42a0-9dad-307667ce3328]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:05 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:56:05 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:05 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info" returned: 0 in 0.771s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:05 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:56:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:05 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info Jul 11 03:56:05 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:06 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.861s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3756b89a-7aed-47cc-863c-a21d81b21055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:06 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[00234134-4252-48d2-8213-86227cd5ebd1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:06 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.info" returned: 0 in 0.694s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.966s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:06 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:56:06 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-531179a3-42ea-4db2-976b-34187527b3b4 tempest-GroupSnapshotsV319Test-1780373653 None] group_snapshot 381852a1-db67-4069-8b67-a676f1b19350: created successfully Jul 11 03:56:07 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 0.868s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] group_snapshot 381852a1-db67-4069-8b67-a676f1b19350: deleting Jul 11 03:56:07 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:56:07 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] group_snapshot 381852a1-db67-4069-8b67-a676f1b19350: deleting {{(pid=87437) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "cinder-quobyte-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Lock "cinder-quobyte-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "cinder-quobyte-9dc3814f-1756-49ab-8e0f-cd66aac79c95" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Lock "cinder-quobyte-9dc3814f-1756-49ab-8e0f-cd66aac79c95" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Deleting offline snapshot 9dc3814f-1756-49ab-8e0f-cd66aac79c95 of volume eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] snapshot_file for this snap is: volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3646d7d3-43ce-4ac6-a1bc-4beb9c6b81bf]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:07 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 Jul 11 03:56:07 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:08 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.952s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:08 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819 Jul 11 03:56:08 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:08 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95" returned: 0 in 0.953s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78a54ff-8ee8-46e5-a1aa-580657c686d4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:08 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba Jul 11 03:56:08 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:09 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.1f15eabe-429c-4ced-8f77-d473816c1819" returned: 0 in 0.671s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 -F qcow2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:09 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 -F qcow2 Jul 11 03:56:09 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:09 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:09 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 Jul 11 03:56:09 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:09 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3756b89a-7aed-47cc-863c-a21d81b21055 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 -F qcow2" returned: 0 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-1f15eabe-429c-4ced-8f77-d473816c1819" released by "_delete_snapshot" :: held 6.940s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" released by "delete_snapshot" :: held 6.964s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Created reservations ['a20592bd-084a-4952-9169-92def98c3283', '3ffefb56-de63-4d0d-b5bf-286db3451c18', '7453e51b-9636-4fe4-a4c3-f1d1075015b5', 'fda39588-28d5-4f56-8cc4-15246d7982da'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Delete snapshot completed successfully. Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-1f15eabe-429c-4ced-8f77-d473816c1819-delete_snapshot" released by "delete_snapshot" :: held 7.126s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-512ba78a-b258-495b-b11a-65f6bd7ba157-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-512ba78a-b258-495b-b11a-65f6bd7ba157-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-512ba78a-b258-495b-b11a-65f6bd7ba157" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-512ba78a-b258-495b-b11a-65f6bd7ba157" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Deleting offline snapshot 512ba78a-b258-495b-b11a-65f6bd7ba157 of volume 3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] snapshot_file for this snap is: volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bf7b53-bf35-4777-9e5c-d3cb7ac53ebc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:10 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 Jul 11 03:56:10 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:10 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95" returned: 0 in 0.854s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:10 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95 Jul 11 03:56:10 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:10 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157" returned: 0 in 0.866s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3756b89a-7aed-47cc-863c-a21d81b21055(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:10 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba.9dc3814f-1756-49ab-8e0f-cd66aac79c95" returned: 0 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[40987d9d-cc1b-49d1-bc10-b3483adddac1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Lock "cinder-quobyte-9dc3814f-1756-49ab-8e0f-cd66aac79c95" released by "_delete_snapshot" :: held 3.458s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Lock "cinder-quobyte-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" released by "delete_snapshot" :: held 3.492s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:11 devstack cinder-volume[87437]: WARNING cinder.quota [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2027766572 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2027766572, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:56:11 devstack cinder-volume[87437]: WARNING cinder.quota [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2027766572 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2027766572, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] Created reservations ['e8ac5c43-a8ff-4f44-9a7b-8773664df66a', '8f24046c-204f-443d-9085-ba9fdba4558a', 'dbd50c10-6d5b-41c9-a01d-3ac341b6a125', 'a7e9a0f2-2979-4d12-a23c-e9b7f1b5bac4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:11 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:56:11 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1f5ab12d-4e86-4fcb-865f-6dae5cda7b5e tempest-GroupSnapshotsV319Test-1780373653 None] group_snapshot 381852a1-db67-4069-8b67-a676f1b19350: deleted successfully Jul 11 03:56:11 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 0.833s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:11 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 Jul 11 03:56:11 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "cinder-quobyte-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Lock "cinder-quobyte-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:12 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fdbd5f-c86c-48b6-957b-89c43050c748]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:12 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba Jul 11 03:56:12 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:12 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157" returned: 0 in 0.985s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:12 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157 Jul 11 03:56:12 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:13 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" returned: 0 in 0.890s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:13 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba Jul 11 03:56:13 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:13 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055.512ba78a-b258-495b-b11a-65f6bd7ba157" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-512ba78a-b258-495b-b11a-65f6bd7ba157" released by "_delete_snapshot" :: held 3.505s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" released by "delete_snapshot" :: held 3.531s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Created reservations ['347912b5-4da0-4651-95da-81e6204f3692', '7d1bab67-b684-46a3-9bf8-33246d02b394', '04d195c9-8468-4498-afd5-78aa76c17eea', 'eba470e9-917b-4974-9813-164190b0c3cb'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Delete snapshot completed successfully. Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-512ba78a-b258-495b-b11a-65f6bd7ba157-delete_snapshot" released by "delete_snapshot" :: held 3.736s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Snapshots deleted, issuing volume delete {{(pid=87437) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea680906-1ece-4cf9-9634-2787a78701ed]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:13 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:56:13 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:13 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" returned: 0 in 0.707s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Lock "cinder-quobyte-eec81e13-5836-4d50-aeaa-e2f0ecc5a7ba" released by "delete_volume" :: held 1.752s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Created reservations ['837db2e6-dbaf-4d83-8434-94545c1b1e5c'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:14 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:56:14 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:14 devstack cinder-volume[87437]: WARNING cinder.quota [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2027766572 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2027766572, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Created reservations ['ddb015fe-fa06-46d5-b42d-beaee364f741', '82dbc630-07b6-41fe-a1e3-5739ad81a2be', '22bf1bea-0d8e-48c8-8335-f9ce5877e908', '79a513b1-9e47-496f-a271-c602b5107519'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:14 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:56:14 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:14 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 1.094s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:14 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055 Jul 11 03:56:14 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-c7eb4f02-99e5-420b-9d7b-01855418aaec req-603ec96c-b616-4181-83d4-967ce51ee021 tempest-AttachVolumeShelveTestJSON-330745257 None] No connector for attachment ea2b0582-1035-450e-b0e2-0e0349b87fa1; skipping storage backend terminate_connection call. {{(pid=87437) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-c7eb4f02-99e5-420b-9d7b-01855418aaec req-603ec96c-b616-4181-83d4-967ce51ee021 tempest-AttachVolumeShelveTestJSON-330745257 None] Deleting attachment ea2b0582-1035-450e-b0e2-0e0349b87fa1. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 03:56:15 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.218s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 8 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:56:15 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.076s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:56:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7e7cfedf-6e24-4b94-bfeb-135ca75946d7 tempest-GroupSnapshotsV319Test-1780373653 None] Delete group completed successfully. Jul 11 03:56:15 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3756b89a-7aed-47cc-863c-a21d81b21055" returned: 0 in 0.831s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3756b89a-7aed-47cc-863c-a21d81b21055" released by "delete_volume" :: held 2.009s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Created reservations ['24fad3c7-e147-4ad6-b55f-5b4477869a76', 'e4ddcf4b-3ca1-4554-b1c6-c52d866ad53c', '43b688d6-207b-4bad-80b1-417fff3c14ea', 'c702086a-2d12-49c3-8ec3-7bbaac7ef1bc'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:15 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:56:15 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:16 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.765s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:16 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:56:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Deleted volume successfully. Jul 11 03:56:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c5efb38-3883-4aca-8768-a20eee970645 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-3756b89a-7aed-47cc-863c-a21d81b21055-delete_volume" released by "delete_volume" :: held 13.986s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Flow 'volume_create_manager' (f5a19489-b2f2-4f89-b726-7e7b5452e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d7f833-8ae9-452e-8924-2a629172c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d7f833-8ae9-452e-8924-2a629172c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-400141830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3505d6ee-1949-4b20-b7dc-6964f55f3d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0634cdbdb4427ea928a89ac66670eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:18Z,use_quota=True,user_id='e9d1b149272d46e69525a1792d8733b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c8c80c-7b7a-4de1-90a0-18299a20bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c8c80c-7b7a-4de1-90a0-18299a20bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a3ab0b-2777-411f-b1eb-c6f8a823c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a3ab0b-2777-411f-b1eb-c6f8a823c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3505d6ee-1949-4b20-b7dc-6964f55f3d5a', 'volume_name': 'volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d70b0e-915f-4f97-83c6-03b5183c55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d70b0e-915f-4f97-83c6-03b5183c55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1c10f5-8612-4732-b7d0-311a0af85427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Volume 3505d6ee-1949-4b20-b7dc-6964f55f3d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a', 'volume_size': 1} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-400141830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3505d6ee-1949-4b20-b7dc-6964f55f3d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0634cdbdb4427ea928a89ac66670eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:18Z,use_quota=True,user_id='e9d1b149272d46e69525a1792d8733b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Creating volume 3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:56:17 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:56:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:17 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a 1073741824 Jul 11 03:56:17 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:18 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a 1073741824" returned: 0 in 0.986s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:18 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:18 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:19 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 0.694s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1c10f5-8612-4732-b7d0-311a0af85427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60af9b0d-a46f-4237-a641-066369e44d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:19 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Volume volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a (3505d6ee-1949-4b20-b7dc-6964f55f3d5a): created successfully Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60af9b0d-a46f-4237-a641-066369e44d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Flow 'volume_create_manager' (f5a19489-b2f2-4f89-b726-7e7b5452e92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ea237ec0-b194-4638-9ee3-699154574d89 tempest-VolumesDeleteCascade-1089790367 None] Created volume successfully. Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Creating offline snapshot d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 of volume 3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5803e4-5171-48b8-bcbd-b185dce9114e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:20 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:20 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-62601240-2cf5-4a81-9987-ac57b3895f45 tempest-GroupsV314Test-1818991289 None] Group tempest-GroupsV314Test-Group-358902232: creating Jul 11 03:56:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-62601240-2cf5-4a81-9987-ac57b3895f45 tempest-GroupsV314Test-1818991289 None] Group tempest-GroupsV314Test-Group-358902232: created successfully Jul 11 03:56:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-62601240-2cf5-4a81-9987-ac57b3895f45 tempest-GroupsV314Test-1818991289 None] Create group completed successfully. Jul 11 03:56:20 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 0.829s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:20 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 1G Jul 11 03:56:20 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:21 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 1G" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:21 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 Jul 11 03:56:21 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Flow 'volume_create_manager' (7741fd4a-ecd7-40eb-8882-36063438278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:22 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58280aa-afd5-48d6-aea9-442e0ca3710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" returned: 0 in 0.779s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:22 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 is being set with open permissions: ugo+rw Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58280aa-afd5-48d6-aea9-442e0ca3710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883182554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d2ba234-6219-4299-a787-9aec77ae425c,host='devstack@QuobyteHD#QuobyteHD',id=0916d920-f846-444f-a42f-ba4fe1ae1166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7753f9f924528b55359c4e9890d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:22Z,use_quota=True,user_id='590305c9dd0f4c2b827278ec5bc8263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4a9ff79-ad1a-43a7-87bf-129f8722f522),volume_type_id=f4a9ff79-ad1a-43a7-87bf-129f8722f522)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:22 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 Jul 11 03:56:22 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea8c85a-ad31-4005-9bc3-54cec3251398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea8c85a-ad31-4005-9bc3-54cec3251398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec3fc01-19cd-46a8-98b6-55eff9d0ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec3fc01-19cd-46a8-98b6-55eff9d0ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0916d920-f846-444f-a42f-ba4fe1ae1166', 'volume_name': 'volume-0916d920-f846-444f-a42f-ba4fe1ae1166', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8430d0d-91da-433c-9857-88aff37ed375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8430d0d-91da-433c-9857-88aff37ed375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f221597-a541-4bc1-9cb2-4531f69df3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:22 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Volume 0916d920-f846-444f-a42f-ba4fe1ae1166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0916d920-f846-444f-a42f-ba4fe1ae1166', 'volume_size': 1} Jul 11 03:56:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:23 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" returned: 0 in 0.646s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:23 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info Jul 11 03:56:23 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:23 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info" returned: 0 in 0.692s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:23 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info is being set with open permissions: ugo+rw Jul 11 03:56:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:23 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info Jul 11 03:56:23 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:24 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.info" returned: 0 in 0.674s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.488s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8d2ba234-6219-4299-a787-9aec77ae425c,created_at=2026-07-11T01:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883182554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8d2ba234-6219-4299-a787-9aec77ae425c,host='devstack@QuobyteHD#QuobyteHD',id=0916d920-f846-444f-a42f-ba4fe1ae1166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7753f9f924528b55359c4e9890d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:22Z,use_quota=True,user_id='590305c9dd0f4c2b827278ec5bc8263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4a9ff79-ad1a-43a7-87bf-129f8722f522),volume_type_id=f4a9ff79-ad1a-43a7-87bf-129f8722f522)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Creating volume 0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:56:24 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:56:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:24 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 1073741824 Jul 11 03:56:24 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:24 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b60bca11-61b9-422f-b2e5-6c135b5f956d tempest-VolumesDeleteCascade-1089790367 None] Create snapshot completed successfully Jul 11 03:56:25 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 1073741824" returned: 0 in 0.895s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:25 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:25 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Flow 'volume_create_manager' (7922d92b-6626-400f-a886-4fd503bb5d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf09d36-0994-40a1-b562-173a49ce58ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf09d36-0994-40a1-b562-173a49ce58ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-937243815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ad6310-0181-40ca-ab83-173c3db98679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0634cdbdb4427ea928a89ac66670eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6e22c3f-21a7-400e-99dd-a4c0b59a36c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:26Z,use_quota=True,user_id='e9d1b149272d46e69525a1792d8733b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd6f1cd-266e-4bda-982d-f140514ddfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd6f1cd-266e-4bda-982d-f140514ddfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c9b15a-2693-480c-b441-22ca5afc36bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c9b15a-2693-480c-b441-22ca5afc36bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53ad6310-0181-40ca-ab83-173c3db98679', 'volume_name': 'volume-53ad6310-0181-40ca-ab83-173c3db98679', 'volume_size': 1, 'snapshot_id': 'd6e22c3f-21a7-400e-99dd-a4c0b59a36c3'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f7c6cd-d7d9-4c6b-bf53-5e769f4d2230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f7c6cd-d7d9-4c6b-bf53-5e769f4d2230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa590d8-447c-4da2-a991-be2d4030fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:25 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Volume 53ad6310-0181-40ca-ab83-173c3db98679: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53ad6310-0181-40ca-ab83-173c3db98679', 'volume_size': 1, 'snapshot_id': 'd6e22c3f-21a7-400e-99dd-a4c0b59a36c3'} Jul 11 03:56:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:26 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 0.680s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.132s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3-53ad6310-0181-40ca-ab83-173c3db98679" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f221597-a541-4bc1-9cb2-4531f69df3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0916d920-f846-444f-a42f-ba4fe1ae1166', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acdc33-3ae1-42f8-9d4a-731042dcd7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3-53ad6310-0181-40ca-ab83-173c3db98679" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Creating volume 53ad6310-0181-40ca-ab83-173c3db98679 from snapshot d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-53ad6310-0181-40ca-ab83-173c3db98679" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-53ad6310-0181-40ca-ab83-173c3db98679" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] snapshot: d6e22c3f-21a7-400e-99dd-a4c0b59a36c3, volume: 53ad6310-0181-40ca-ab83-173c3db98679, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 03:56:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Volume volume-0916d920-f846-444f-a42f-ba4fe1ae1166 (0916d920-f846-444f-a42f-ba4fe1ae1166): created successfully Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acdc33-3ae1-42f8-9d4a-731042dcd7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Flow 'volume_create_manager' (7741fd4a-ecd7-40eb-8882-36063438278b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cd87904b-02be-49e3-bc62-8688efbe465d tempest-GroupsV314Test-1818991289 None] Created volume successfully. Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3a2e00-3727-494d-8d58-8a9c80de4b09]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:26 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 Jul 11 03:56:26 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:27 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" returned: 0 in 0.902s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 03:56:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 03:56:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0b0842-a50a-4c4c-a275-e8e4c478a6cc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:27 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:27 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:28 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 0.913s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:28 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 03:56:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:28 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 Jul 11 03:56:28 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:33 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679" returned: 0 in 5.456s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[11359e64-7c35-4a4d-bfc9-49fea37005ed]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:33 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:33 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:34 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 0.934s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:34 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:56:34 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Converted 1024.00 MB image at 187.66 MB/s Jul 11 03:56:34 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 is being set with open permissions: ugo+rw Jul 11 03:56:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:34 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 Jul 11 03:56:34 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:35 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679" returned: 0 in 0.773s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-53ad6310-0181-40ca-ab83-173c3db98679" released by "_copy_volume_from_snapshot" :: held 9.108s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3-53ad6310-0181-40ca-ab83-173c3db98679" released by "_create_volume_from_snapshot" :: held 9.144s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.171s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.954s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:35 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Cloning volume 0916d920-f846-444f-a42f-ba4fe1ae1166 to volume a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa590d8-447c-4da2-a991-be2d4030fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ad6310-0181-40ca-ab83-173c3db98679', 'volume_size': 1, 'snapshot_id': 'd6e22c3f-21a7-400e-99dd-a4c0b59a36c3'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1a2c5c-dc14-41f4-90e2-c897df25ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Volume volume-53ad6310-0181-40ca-ab83-173c3db98679 (53ad6310-0181-40ca-ab83-173c3db98679): created successfully Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1a2c5c-dc14-41f4-90e2-c897df25ab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Flow 'volume_create_manager' (7922d92b-6626-400f-a886-4fd503bb5d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Creating offline snapshot 03861d40-d6a2-4d11-9cd1-274e8c7ddde2 of volume 0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:56:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5ac3104e-6eb3-499b-9d23-81dac2f425a4 tempest-VolumesDeleteCascade-1089790367 None] Created volume successfully. Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d17953-c51e-4a1d-9ff8-3dec7d571561]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:35 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:35 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-3505d6ee-1949-4b20-b7dc-6964f55f3d5a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-3505d6ee-1949-4b20-b7dc-6964f55f3d5a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Performing cascade delete. {{(pid=87437) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Deleting offline snapshot d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 of volume 3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:56:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] snapshot_file for this snap is: volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:56:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff047e50-141e-4b22-8eeb-aa42bdbe700c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:36 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 Jul 11 03:56:36 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:36 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 0.862s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:36 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 1G Jul 11 03:56:36 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:36 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" returned: 0 in 0.952s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:37 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b20ad03-2b8a-4bbc-8669-0c269220d97b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:37 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:37 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:37 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 1G" returned: 0 in 1.229s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0916d920-f846-444f-a42f-ba4fe1ae1166 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:37 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0916d920-f846-444f-a42f-ba4fe1ae1166 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 Jul 11 03:56:37 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:38 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 1.016s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:38 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 Jul 11 03:56:38 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:38 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0916d920-f846-444f-a42f-ba4fe1ae1166 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2" returned: 0 in 1.060s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:38 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:56:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:38 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 Jul 11 03:56:38 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:39 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" returned: 0 in 1.029s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:39 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3 Jul 11 03:56:39 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:39 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2" returned: 0 in 0.763s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:39 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info Jul 11 03:56:39 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:39 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a.d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" returned: 0 in 0.801s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3" released by "_delete_snapshot" :: held 3.932s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" released by "delete_snapshot" :: held 3.960s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Created reservations ['6fd4585a-50db-4223-84a4-e8e2c27a60dc', '9874b8ea-79b7-477c-9f1a-a95e78becc9f', '0b39b962-ba54-4bc7-8cbe-d393fc3af68c', '29f2f3b0-b483-4453-956e-11281563edbc'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Delete snapshot completed successfully. Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-d6e22c3f-21a7-400e-99dd-a4c0b59a36c3-delete_snapshot" released by "delete_snapshot" :: held 4.245s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Snapshots deleted, issuing volume delete {{(pid=87437) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:40 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" acquired by "delete_volume" :: waited 0.038s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info" returned: 0 in 0.885s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:40 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8657c2-93d1-470d-8952-8a6ac381d0d9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:40 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info Jul 11 03:56:40 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:40 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:40 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:40 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.info" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Acquiring lock "cinder-quobyte-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] snapshot: 03861d40-d6a2-4d11-9cd1-274e8c7ddde2, volume: a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8455bd1-8795-4778-a188-85f40f5d91b1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:41 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 Jul 11 03:56:41 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:41 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 1.009s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:41 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a Jul 11 03:56:41 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:41 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2" returned: 0 in 0.852s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0916d920-f846-444f-a42f-ba4fe1ae1166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abf7f22-e95a-4074-b332-88acd46045a9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:42 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:42 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:42 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" returned: 0 in 0.752s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-3505d6ee-1949-4b20-b7dc-6964f55f3d5a" released by "delete_volume" :: held 1.860s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Created reservations ['f44b7aa9-f720-4773-b1cb-128ce0c004f6', 'd21fe20e-9de8-4f07-b952-9ea8f7a2b5e3', 'bb0f1d0e-cd36-41bb-b7a8-da12c52d9bc2', '38f556de-acc6-435d-ac0c-79c8eeae82b9'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:42 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:56:42 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-53ad6310-0181-40ca-ab83-173c3db98679-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-53ad6310-0181-40ca-ab83-173c3db98679-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:42 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 0.921s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "cinder-quobyte-53ad6310-0181-40ca-ab83-173c3db98679" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:42 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 Jul 11 03:56:42 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-53ad6310-0181-40ca-ab83-173c3db98679" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c50ad4-4463-443f-81c2-39f59c12f2d6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:43 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.883s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:43 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:56:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Deleted volume successfully. Jul 11 03:56:43 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 Jul 11 03:56:43 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5e8ba19f-a2dd-40e1-aac0-440dc17ed1f6 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-3505d6ee-1949-4b20-b7dc-6964f55f3d5a-delete_volume" released by "delete_volume" :: held 7.273s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:44 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679" returned: 0 in 1.205s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:44 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679 Jul 11 03:56:44 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:46 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-53ad6310-0181-40ca-ab83-173c3db98679" returned: 0 in 2.079s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-quobyte-53ad6310-0181-40ca-ab83-173c3db98679" released by "delete_volume" :: held 3.381s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Created reservations ['bc4835ce-1389-42ed-821e-1089630cd84e', '59464c6d-7823-4039-888f-f4fe50db014f', '492f7990-4ae7-4c58-93da-1c3944f70231', '3471f372-3b3c-498d-a94f-c5ab9b52cdb2'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=90,cinder:INSERT=27,cinder:UPDATE=89,cinder:DELETE=6 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:46 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:56:46 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:48 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 2.179s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:48 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:56:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Deleted volume successfully. Jul 11 03:56:49 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=89,cinder:INSERT=21,cinder:UPDATE=96,cinder:DELETE=6 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:56:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4820ab9c-1ab7-48d2-948b-47c2c0a19572 tempest-VolumesDeleteCascade-1089790367 None] Lock "cinder-53ad6310-0181-40ca-ab83-173c3db98679-delete_volume" released by "delete_volume" :: held 6.289s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:49 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" returned: 0 in 6.858s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8ca037-54de-4d42-93ed-58fb2103364c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:49 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:49 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:50 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 1.115s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:50 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:56:50 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Converted 1024.00 MB image at 149.29 MB/s Jul 11 03:56:50 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 is being set with open permissions: ugo+rw: NotImplementedError Jul 11 03:56:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:50 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 Jul 11 03:56:50 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:51 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" returned: 0 in 0.672s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" released by "_copy_volume_from_snapshot" :: held 10.494s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Acquiring lock "cinder-quobyte-03861d40-d6a2-4d11-9cd1-274e8c7ddde2" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-03861d40-d6a2-4d11-9cd1-274e8c7ddde2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Deleting offline snapshot 03861d40-d6a2-4d11-9cd1-274e8c7ddde2 of volume 0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] snapshot_file for this snap is: volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc392778-1880-4300-8974-c73886b2a266]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:51 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 Jul 11 03:56:51 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:52 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2" returned: 0 in 0.802s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0916d920-f846-444f-a42f-ba4fe1ae1166(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:56:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e47dfbe-1b35-47a1-a2cf-9bcc186e175c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:52 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:52 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:53 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 0.765s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:53 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 Jul 11 03:56:53 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Flow 'volume_create_manager' (7fad6794-a1fd-4006-9be9-9e0c80a7bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5f0af-ca66-463d-803b-72efb9f43d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c5f0af-ca66-463d-803b-72efb9f43d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1162267283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d923bb-0551-4a19-b547-f8b9d84f22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432aeb27ac7642089071d321563e3669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:54Z,use_quota=True,user_id='611b6166bc0e4899bebfa075970bd20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3b3789-07da-4c8c-b8d8-75f5d814abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3b3789-07da-4c8c-b8d8-75f5d814abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06982c6e-7e4c-4a95-aaa0-a2815470c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06982c6e-7e4c-4a95-aaa0-a2815470c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d923bb-0551-4a19-b547-f8b9d84f22f3', 'volume_name': 'volume-24d923bb-0551-4a19-b547-f8b9d84f22f3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa09e38b-8145-447d-840f-9143c01c42f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa09e38b-8145-447d-840f-9143c01c42f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0515fc-796f-4ddb-82d3-e0caee785021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:53 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Volume 24d923bb-0551-4a19-b547-f8b9d84f22f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d923bb-0551-4a19-b547-f8b9d84f22f3', 'volume_size': 1} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:53 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:53 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2 Jul 11 03:56:53 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:54 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166.03861d40-d6a2-4d11-9cd1-274e8c7ddde2" returned: 0 in 0.630s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-03861d40-d6a2-4d11-9cd1-274e8c7ddde2" released by "_delete_snapshot" :: held 3.032s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.356s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1162267283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d923bb-0551-4a19-b547-f8b9d84f22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432aeb27ac7642089071d321563e3669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:56:54Z,use_quota=True,user_id='611b6166bc0e4899bebfa075970bd20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Creating volume 24d923bb-0551-4a19-b547-f8b9d84f22f3 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:56:54 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:56:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:54 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 1073741824 Jul 11 03:56:54 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:54 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a0c6f355-eb1a-43a9-9a8b-f6885511b4a8 tempest-GroupsV314Test-1818991289 None] Create group from source-group-8d2ba234-6219-4299-a787-9aec77ae425c completed successfully. Jul 11 03:56:55 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 1073741824" returned: 0 in 0.811s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:55 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 Jul 11 03:56:55 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Acquiring lock "cinder-quobyte-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:56 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3" returned: 0 in 0.670s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae42b8bd-afbf-4ba9-9575-ec2bf5fc08bf]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0515fc-796f-4ddb-82d3-e0caee785021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d923bb-0551-4a19-b547-f8b9d84f22f3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a48a6e-a810-4f05-b75f-bef5f2db12f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:56:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Volume volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 (24d923bb-0551-4a19-b547-f8b9d84f22f3): created successfully Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a48a6e-a810-4f05-b75f-bef5f2db12f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Flow 'volume_create_manager' (7fad6794-a1fd-4006-9be9-9e0c80a7bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:56:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f9c1635c-7cd1-4102-8d03-17cc0890bdfb tempest-VolumesTransfersTest-259091585 None] Created volume successfully. Jul 11 03:56:56 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 Jul 11 03:56:56 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:56 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" returned: 0 in 0.761s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:56 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1 Jul 11 03:56:56 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:57 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" returned: 0 in 0.704s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-a9a5ad7e-3c8e-44ba-87fb-75f081bb0cb1" released by "delete_volume" :: held 1.520s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:56:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-23ba9023-3a94-48d2-883e-d3549c965551 tempest-VolumesTransfersTest-25659779 None] Transfer volume completed successfully. Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Created reservations ['23dbd0be-b1e9-4df7-be30-e60009f86392'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:57 devstack cinder-volume[87437]: WARNING cinder.quota [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-132250973 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-132250973, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:56:57 devstack cinder-volume[87437]: WARNING cinder.quota [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-132250973 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-132250973, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Created reservations ['19b66deb-d5f1-485f-9a60-562354f038e6', 'bfc3af90-b3b4-486b-9405-2f537b63bf9b', '3935dd89-4f49-40b2-b298-169cb1ec1db7', '8aeabf05-ca58-4804-9a25-0c97f2d14b92'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:56:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:57 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:56:57 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:58 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:56:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-97fb0fea-8681-4d59-9d81-5883110fea7b tempest-GroupsV314Test-1818991289 None] Delete group completed successfully. Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Acquiring lock "cinder-24d923bb-0551-4a19-b547-f8b9d84f22f3-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Lock "cinder-24d923bb-0551-4a19-b547-f8b9d84f22f3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Acquiring lock "cinder-quobyte-0916d920-f846-444f-a42f-ba4fe1ae1166" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Acquiring lock "cinder-quobyte-24d923bb-0551-4a19-b547-f8b9d84f22f3" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-0916d920-f846-444f-a42f-ba4fe1ae1166" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Lock "cinder-quobyte-24d923bb-0551-4a19-b547-f8b9d84f22f3" acquired by "delete_volume" :: waited 0.044s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8351809-a51f-42f1-959e-4532b5e65d10]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5049cef7-de57-4f90-bf7b-56ef3506ca5a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:56:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:59 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:59 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:59 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 Jul 11 03:56:59 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:59 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 0.766s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:59 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166 Jul 11 03:56:59 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:56:59 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Jul 11 03:56:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3" returned: 0 in 0.839s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:56:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:56:59 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3 Jul 11 03:56:59 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:00 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0916d920-f846-444f-a42f-ba4fe1ae1166" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Lock "cinder-quobyte-0916d920-f846-444f-a42f-ba4fe1ae1166" released by "delete_volume" :: held 1.566s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:00 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-24d923bb-0551-4a19-b547-f8b9d84f22f3" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Lock "cinder-quobyte-24d923bb-0551-4a19-b547-f8b9d84f22f3" released by "delete_volume" :: held 1.591s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Created reservations ['62f1f9d8-802a-4d8d-9941-910f986e0dc5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Created reservations ['8f1cfaee-e28e-4497-a272-1b695de334b8', '937c4bca-f02c-4f55-9234-f42542468225', '1126f26d-78d2-4638-b18c-a96bf43480ec', 'b167a5f6-c2f0-4183-b8de-d3a07adda047'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Created reservations ['eea34448-415e-483b-9cfe-a8e93c0f7d08', 'dcb2797f-fcb1-4031-b7a8-68844f0ca6a9', '84952e6f-b586-4204-aed3-2fe859537181', '05679f1a-b13d-48b9-a0f0-99e828597a7f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:00 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:00 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:00 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:00 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:01 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:01 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.716s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.839s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-32da628a-abed-46eb-8e95-64a1addb9e11 tempest-GroupsV314Test-1818991289 None] Delete group completed successfully. Jul 11 03:57:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Deleted volume successfully. Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51d50dd0-650d-4915-97ce-b2caa536be3a tempest-VolumesTransfersTest-634690882 None] Lock "cinder-24d923bb-0551-4a19-b547-f8b9d84f22f3-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Flow 'volume_create_manager' (6196b9e0-e725-471f-bd7f-4c4dad6bd56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e72521-96c2-4912-85d6-c6f4539d1e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e72521-96c2-4912-85d6-c6f4539d1e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-856623511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208b395a-867a-4163-81ee-d7ecfb975175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432aeb27ac7642089071d321563e3669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:02Z,use_quota=True,user_id='611b6166bc0e4899bebfa075970bd20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6172e5-c609-4432-8900-f969bb8dc6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6172e5-c609-4432-8900-f969bb8dc6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31722901-ce30-4c2a-87bb-c4bc27919bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31722901-ce30-4c2a-87bb-c4bc27919bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208b395a-867a-4163-81ee-d7ecfb975175', 'volume_name': 'volume-208b395a-867a-4163-81ee-d7ecfb975175', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b6619e-8211-49d4-9b87-9bdfa59d9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b6619e-8211-49d4-9b87-9bdfa59d9e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2f66f9-5715-4c77-aee9-5891952d03a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Volume 208b395a-867a-4163-81ee-d7ecfb975175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208b395a-867a-4163-81ee-d7ecfb975175', 'volume_size': 1} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-856623511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208b395a-867a-4163-81ee-d7ecfb975175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='432aeb27ac7642089071d321563e3669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:02Z,use_quota=True,user_id='611b6166bc0e4899bebfa075970bd20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Creating volume 208b395a-867a-4163-81ee-d7ecfb975175 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:01 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:01 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 1073741824 Jul 11 03:57:01 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:02 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 1073741824" returned: 0 in 1.160s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:03 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 Jul 11 03:57:03 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:03 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175" returned: 0 in 0.777s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2f66f9-5715-4c77-aee9-5891952d03a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208b395a-867a-4163-81ee-d7ecfb975175', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df7da4f-1a64-4677-a34e-5bc32331674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Volume volume-208b395a-867a-4163-81ee-d7ecfb975175 (208b395a-867a-4163-81ee-d7ecfb975175): created successfully Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df7da4f-1a64-4677-a34e-5bc32331674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Flow 'volume_create_manager' (6196b9e0-e725-471f-bd7f-4c4dad6bd56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-079c3075-d49b-4218-b9f7-9182fdd8a607 tempest-VolumesTransfersTest-259091585 None] Created volume successfully. Jul 11 03:57:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Acquiring lock "cinder-208b395a-867a-4163-81ee-d7ecfb975175-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Lock "cinder-208b395a-867a-4163-81ee-d7ecfb975175-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Acquiring lock "cinder-quobyte-208b395a-867a-4163-81ee-d7ecfb975175" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Lock "cinder-quobyte-208b395a-867a-4163-81ee-d7ecfb975175" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:05 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e4eda-8ac2-47cc-9fff-03161e5929f0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:05 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 Jul 11 03:57:05 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:06 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175" returned: 0 in 0.780s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:06 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175 Jul 11 03:57:06 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:06 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-208b395a-867a-4163-81ee-d7ecfb975175" returned: 0 in 0.747s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Lock "cinder-quobyte-208b395a-867a-4163-81ee-d7ecfb975175" released by "delete_volume" :: held 1.570s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Created reservations ['aaa99419-9d96-44a8-a6a9-d41967e0dee4', 'fe831cdf-a6a4-48d2-9b86-7631bf279cb8', 'ab8caf29-b1dc-4d32-8444-b07237ec6535', 'f4abb8e7-b53f-44e2-a170-ac7b6a254dfe'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:07 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:07 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f115abaf-2f8b-47db-b2b9-51479ebc6273 tempest-GroupsV320Test-879922969 None] Group tempest-GroupsV320Test-Group-1643857957: creating Jul 11 03:57:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f115abaf-2f8b-47db-b2b9-51479ebc6273 tempest-GroupsV320Test-879922969 None] Group tempest-GroupsV320Test-Group-1643857957: created successfully Jul 11 03:57:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f115abaf-2f8b-47db-b2b9-51479ebc6273 tempest-GroupsV320Test-879922969 None] Create group completed successfully. Jul 11 03:57:07 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.665s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:07 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Deleted volume successfully. Jul 11 03:57:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec301a10-ba88-4734-b66b-2c9e82199a09 tempest-VolumesTransfersTest-634690882 None] Lock "cinder-208b395a-867a-4163-81ee-d7ecfb975175-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Created reservations ['02c087d2-9371-4d7a-ae30-7171b06ed9ea'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:08 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:08 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Acquiring lock "cinder-9c5b0593-c803-461b-8a07-78d6869c6fa6-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "cinder-9c5b0593-c803-461b-8a07-78d6869c6fa6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Acquiring lock "cinder-quobyte-9c5b0593-c803-461b-8a07-78d6869c6fa6" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "cinder-quobyte-9c5b0593-c803-461b-8a07-78d6869c6fa6" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abad44d-54bb-4104-a8a9-00229c3db403]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:09 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.747s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:09 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ed0f7cc6-84ad-4a45-a682-d829613a48bd tempest-GroupsV320Test-879922969 None] Delete group completed successfully. Jul 11 03:57:09 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 Jul 11 03:57:09 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:10 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6" returned: 0 in 0.852s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:10 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6 Jul 11 03:57:10 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:11 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9c5b0593-c803-461b-8a07-78d6869c6fa6" returned: 0 in 0.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "cinder-quobyte-9c5b0593-c803-461b-8a07-78d6869c6fa6" released by "delete_volume" :: held 1.665s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Created reservations ['b4c0bafd-bf3f-4ddf-b1c0-525907c97d5d', '2ee006f8-1b29-4a58-9834-52a5e60029ab', '98765560-b9c9-42ac-90b8-5797d896cc6a', '1b7ec300-0f74-4f6d-bcf5-b45509c3840d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:11 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:11 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:11 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.824s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Deleted volume successfully. Jul 11 03:57:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8d2143b0-7af4-48ec-aa8d-f07f4f9c3ec1 tempest-AttachVolumeShelveTestJSON-330745257 None] Lock "cinder-9c5b0593-c803-461b-8a07-78d6869c6fa6-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:14 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:14 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:14 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.773s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:57:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Flow 'volume_create_manager' (a2b60f8d-1835-494a-a9ed-fd3747f20f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2569be-f4b9-4fe5-b8b3-e9c946be2b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2569be-f4b9-4fe5-b8b3-e9c946be2b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-127739157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb64b89-4d88-424b-b2fc-02d0610b53ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2295808d6074c778a0bea0856e3520d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:15Z,use_quota=True,user_id='54c235450f044c20b74f84655c32a443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf70762c-4f4a-4075-a178-a0a5b0834653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf70762c-4f4a-4075-a178-a0a5b0834653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5359f407-a501-4a01-929a-458d89e0701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5359f407-a501-4a01-929a-458d89e0701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb64b89-4d88-424b-b2fc-02d0610b53ff', 'volume_name': 'volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4902ef0e-d7e8-4911-9a63-a447839890ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4902ef0e-d7e8-4911-9a63-a447839890ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048e37bd-3a3b-4a8e-92fa-b6fed810b715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Volume 0cb64b89-4d88-424b-b2fc-02d0610b53ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff', 'volume_size': 1} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-127739157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb64b89-4d88-424b-b2fc-02d0610b53ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2295808d6074c778a0bea0856e3520d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:15Z,use_quota=True,user_id='54c235450f044c20b74f84655c32a443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Creating volume 0cb64b89-4d88-424b-b2fc-02d0610b53ff {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:15 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:15 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff 1073741824 Jul 11 03:57:15 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Flow 'volume_create_manager' (cf4b674a-3a93-4763-8611-ef70ea7a01d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dda1b2-6f52-4037-963f-cd67aedb2fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dda1b2-6f52-4037-963f-cd67aedb2fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1955953091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9755a21c-21b1-42e4-b3a0-ee6b32747087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ba2a7169df40168cc1b7607524f2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:16Z,use_quota=True,user_id='aec3f266567c4e37b9aa47d875220a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:16 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b893cb-5c44-4857-8298-58e972cfed13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b893cb-5c44-4857-8298-58e972cfed13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ae6d79-609e-41fa-9f8e-2887daeb9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ae6d79-609e-41fa-9f8e-2887daeb9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9755a21c-21b1-42e4-b3a0-ee6b32747087', 'volume_name': 'volume-9755a21c-21b1-42e4-b3a0-ee6b32747087', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c73587-4609-455f-ac19-85a252355d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c73587-4609-455f-ac19-85a252355d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb0d63c-d9c5-4da7-ad35-4cc9a11e32c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:16 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Volume 9755a21c-21b1-42e4-b3a0-ee6b32747087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9755a21c-21b1-42e4-b3a0-ee6b32747087', 'volume_size': 1} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff 1073741824" returned: 0 in 1.040s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:16 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff Jul 11 03:57:16 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:17 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff" returned: 0 in 0.697s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1955953091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9755a21c-21b1-42e4-b3a0-ee6b32747087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ba2a7169df40168cc1b7607524f2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:16Z,use_quota=True,user_id='aec3f266567c4e37b9aa47d875220a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Creating volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:17 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048e37bd-3a3b-4a8e-92fa-b6fed810b715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:17 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 1073741824 Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f60bf1-1fba-4f3b-89e1-e82a68fc8539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:17 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Volume volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff (0cb64b89-4d88-424b-b2fc-02d0610b53ff): created successfully Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f60bf1-1fba-4f3b-89e1-e82a68fc8539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Flow 'volume_create_manager' (a2b60f8d-1835-494a-a9ed-fd3747f20f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:17 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5e347ee0-7111-4597-beb1-c14c07efaab7 tempest-VolumesTransfersV357Test-625116338 None] Created volume successfully. Jul 11 03:57:18 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 1073741824" returned: 0 in 0.900s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:18 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 Jul 11 03:57:18 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:19 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087" returned: 0 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb0d63c-d9c5-4da7-ad35-4cc9a11e32c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9755a21c-21b1-42e4-b3a0-ee6b32747087', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059c38d1-cfed-41e2-adc3-e1901369ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:19 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Volume volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 (9755a21c-21b1-42e4-b3a0-ee6b32747087): created successfully Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059c38d1-cfed-41e2-adc3-e1901369ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Flow 'volume_create_manager' (cf4b674a-3a93-4763-8611-ef70ea7a01d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2aa739ee-8cf9-4b9c-b646-3853779b6324 tempest-SnapshotsActionsTest-742948443 None] Created volume successfully. Jul 11 03:57:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fa66bb5a-d0ed-4219-9b5d-cf1ef3baf57c tempest-VolumesTransfersV357Test-1919286958 None] Transfer volume completed successfully. Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Creating offline snapshot 1bb25a80-736f-4759-8619-b8e74427fc0f of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0161cc-1751-4569-b213-867514349c30]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:19 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 Jul 11 03:57:19 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Flow 'volume_create_manager' (e3da27ac-4e3f-4d71-b647-774453b5a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaca6fc2-3cdd-4607-886c-0b10294def79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaca6fc2-3cdd-4607-886c-0b10294def79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-788595559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2fba66-21e9-4027-9193-a386672807e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7988c66608074aa099692fbfe9e8a27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:20Z,use_quota=True,user_id='442c58a073444ec5baeb4be783e56f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b077bac-1d42-4afd-a356-c70c6d3c2354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b077bac-1d42-4afd-a356-c70c6d3c2354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d3d1c6-5d5c-4dec-8354-bed87977d6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d3d1c6-5d5c-4dec-8354-bed87977d6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2fba66-21e9-4027-9193-a386672807e2', 'volume_name': 'volume-1d2fba66-21e9-4027-9193-a386672807e2', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a05c9-6755-48fd-b158-50103f5e3dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a05c9-6755-48fd-b158-50103f5e3dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6fcac2-8562-41cf-acd7-623110c8ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Volume 1d2fba66-21e9-4027-9193-a386672807e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2fba66-21e9-4027-9193-a386672807e2', 'volume_size': 1} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Acquiring lock "cinder-0cb64b89-4d88-424b-b2fc-02d0610b53ff-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-0cb64b89-4d88-424b-b2fc-02d0610b53ff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:20 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087" returned: 0 in 0.831s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:20 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f 1G Jul 11 03:57:20 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Acquiring lock "cinder-quobyte-0cb64b89-4d88-424b-b2fc-02d0610b53ff" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-quobyte-0cb64b89-4d88-424b-b2fc-02d0610b53ff" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a2b24c-0a66-4f67-a315-ab3a37bca354]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:20 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff Jul 11 03:57:20 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:21 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f 1G" returned: 0 in 0.855s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:21 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:21 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:21 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff" returned: 0 in 0.798s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:21 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff Jul 11 03:57:21 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:22 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cb64b89-4d88-424b-b2fc-02d0610b53ff" returned: 0 in 0.629s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-quobyte-0cb64b89-4d88-424b-b2fc-02d0610b53ff" released by "delete_volume" :: held 1.487s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:22 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.705s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:22 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f is being set with open permissions: ugo+rw Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:22 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:22 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Created reservations ['cc47bffd-bba1-4315-a587-2dabcb30966e', '28f3c29f-e14b-47f7-9c35-f2287557f65d', '42d86b0d-339e-42ec-baa7-65997be06b51', '6aab973f-4272-49b5-ae26-873b68085975'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:22 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:22 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:22 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.666s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:22 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info Jul 11 03:57:22 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:23 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.668s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Deleted volume successfully. Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-458e2dfe-6312-4822-bebb-9b7dd1f84ed8 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-0cb64b89-4d88-424b-b2fc-02d0610b53ff-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Flow 'volume_create_manager' (d5e62f22-ec1e-48ed-8efc-746ea9bbb4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37245d9-f17c-46c2-a29d-2db23a985f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37245d9-f17c-46c2-a29d-2db23a985f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1601389671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c6f94e-120c-4a46-b1b5-d42573572d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2295808d6074c778a0bea0856e3520d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:23Z,use_quota=True,user_id='54c235450f044c20b74f84655c32a443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d414a9-cd67-438a-a8bd-ba0241569c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d414a9-cd67-438a-a8bd-ba0241569c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de63613d-465c-43c7-bd0c-a220ad6f2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de63613d-465c-43c7-bd0c-a220ad6f2bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c6f94e-120c-4a46-b1b5-d42573572d63', 'volume_name': 'volume-30c6f94e-120c-4a46-b1b5-d42573572d63', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98501d27-da03-4bc1-a34b-ec6b6d39e517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98501d27-da03-4bc1-a34b-ec6b6d39e517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b84059-5c76-4601-b447-96b341001d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:23 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Volume 30c6f94e-120c-4a46-b1b5-d42573572d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c6f94e-120c-4a46-b1b5-d42573572d63', 'volume_size': 1} Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:23 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info" returned: 0 in 0.713s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:23 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info is being set with open permissions: ugo+rw Jul 11 03:57:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:23 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info Jul 11 03:57:23 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:24 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.info" returned: 0 in 0.618s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.796s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-788595559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2fba66-21e9-4027-9193-a386672807e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7988c66608074aa099692fbfe9e8a27d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:20Z,use_quota=True,user_id='442c58a073444ec5baeb4be783e56f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Creating volume 1d2fba66-21e9-4027-9193-a386672807e2 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:24 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:24 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 1073741824 Jul 11 03:57:24 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:24 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c7d90aaa-dce2-4d44-9a6f-16bd45e76266 tempest-SnapshotsActionsTest-742948443 None] Create snapshot completed successfully Jul 11 03:57:25 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 1073741824" returned: 0 in 0.828s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:25 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 Jul 11 03:57:25 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:25 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2" returned: 0 in 0.691s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1601389671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c6f94e-120c-4a46-b1b5-d42573572d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2295808d6074c778a0bea0856e3520d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:23Z,use_quota=True,user_id='54c235450f044c20b74f84655c32a443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Creating volume 30c6f94e-120c-4a46-b1b5-d42573572d63 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:25 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:25 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 1073741824 Jul 11 03:57:25 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6fcac2-8562-41cf-acd7-623110c8ac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2fba66-21e9-4027-9193-a386672807e2', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bb9e01-e77d-468b-b03b-6e9a19652f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:25 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Volume volume-1d2fba66-21e9-4027-9193-a386672807e2 (1d2fba66-21e9-4027-9193-a386672807e2): created successfully Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bb9e01-e77d-468b-b03b-6e9a19652f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Flow 'volume_create_manager' (e3da27ac-4e3f-4d71-b647-774453b5a955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:25 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-a0a75750-8711-406f-a9bf-27bf7c4f8bc1 req-1ac1f192-1815-4fd7-ba85-cda196b9503f tempest-VolumesGetTestJSON-1019905420 None] Created volume successfully. Jul 11 03:57:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:26 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 1073741824" returned: 0 in 0.843s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:26 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 Jul 11 03:57:26 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Acquiring lock "cinder-1d2fba66-21e9-4027-9193-a386672807e2-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Lock "cinder-1d2fba66-21e9-4027-9193-a386672807e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Acquiring lock "cinder-quobyte-1d2fba66-21e9-4027-9193-a386672807e2" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Lock "cinder-quobyte-1d2fba66-21e9-4027-9193-a386672807e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38aca7-dd2d-4edc-b69a-ee882fe1c339]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:27 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 Jul 11 03:57:27 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:27 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63" returned: 0 in 0.677s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.438s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b84059-5c76-4601-b447-96b341001d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c6f94e-120c-4a46-b1b5-d42573572d63', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579e1f3e-119f-4f51-8037-a2a5c281d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Creating offline snapshot 4d449d15-636a-4212-aa8d-1e9e3a857422 of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:57:27 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Volume volume-30c6f94e-120c-4a46-b1b5-d42573572d63 (30c6f94e-120c-4a46-b1b5-d42573572d63): created successfully Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579e1f3e-119f-4f51-8037-a2a5c281d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Flow 'volume_create_manager' (d5e62f22-ec1e-48ed-8efc-746ea9bbb4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18cd124-903e-4ae9-b90f-b69047f3db07]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8a1a7df5-5f17-4155-aa91-bf0b3226e8e5 tempest-VolumesTransfersV357Test-625116338 None] Created volume successfully. Jul 11 03:57:27 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:27 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Acquiring lock "cinder-30c6f94e-120c-4a46-b1b5-d42573572d63-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-30c6f94e-120c-4a46-b1b5-d42573572d63-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Acquiring lock "cinder-quobyte-30c6f94e-120c-4a46-b1b5-d42573572d63" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-quobyte-30c6f94e-120c-4a46-b1b5-d42573572d63" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:28 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2" returned: 0 in 0.876s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1224cf1b-aa5b-452f-ab28-3643c7741203]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:28 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2 Jul 11 03:57:28 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:28 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 Jul 11 03:57:28 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:28 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.873s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:28 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 1G Jul 11 03:57:28 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:28 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d2fba66-21e9-4027-9193-a386672807e2" returned: 0 in 0.714s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Lock "cinder-quobyte-1d2fba66-21e9-4027-9193-a386672807e2" released by "delete_volume" :: held 1.641s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.quota [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Created reservations ['a6e37441-ab90-4538-9432-262cac1e8f03', '0c098618-dd01-4dee-91d1-3eeb979412d0', 'f27943fb-6256-4653-b0d5-259dfd7ea3e6', 'bd9c7c10-1880-49c8-93a2-d2c40f3fe38b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:28 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63" returned: 0 in 0.785s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:28 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63 Jul 11 03:57:28 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:28 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:28 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:29 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 1G" returned: 0 in 0.891s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:29 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 Jul 11 03:57:29 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:29 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-30c6f94e-120c-4a46-b1b5-d42573572d63" returned: 0 in 0.758s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-quobyte-30c6f94e-120c-4a46-b1b5-d42573572d63" released by "delete_volume" :: held 1.596s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Created reservations ['b0ed0a34-ed55-4903-a939-6332a0543479', 'abb00892-d0d8-4a0d-b369-47c8b64e0001', 'd5db7f04-fb5a-422d-b6ce-aa36d42aee78', '4463fc87-26ac-4282-8a15-137c94a190dc'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:29 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.815s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG cinder.manager [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Deleted volume successfully. Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-cd0e506b-94ce-44ec-a5a8-733b40d8f120 req-3240a63c-4845-4796-aa1f-30b34ce0b722 tempest-VolumesGetTestJSON-1019905420 None] Lock "cinder-1d2fba66-21e9-4027-9193-a386672807e2-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:29 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:29 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:30 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422" returned: 0 in 0.839s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:30 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 is being set with open permissions: ugo+rw Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:30 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 Jul 11 03:57:30 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:30 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.814s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Deleted volume successfully. Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-022686ab-957a-48ab-969e-2c1cdee1e114 tempest-VolumesTransfersV357Test-1577651270 None] Lock "cinder-30c6f94e-120c-4a46-b1b5-d42573572d63-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:30 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422" returned: 0 in 0.792s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.524s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1f6fcfdf-9d1e-4b11-89ad-c0a352d6c906 tempest-SnapshotsActionsTest-742948443 None] Create snapshot completed successfully Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-4d449d15-636a-4212-aa8d-1e9e3a857422-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-4d449d15-636a-4212-aa8d-1e9e3a857422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-4d449d15-636a-4212-aa8d-1e9e3a857422" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-4d449d15-636a-4212-aa8d-1e9e3a857422" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Deleting offline snapshot 4d449d15-636a-4212-aa8d-1e9e3a857422 of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] snapshot_file for this snap is: volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[412bc223-aa33-48cf-afc0-afa46441ff33]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:31 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 Jul 11 03:57:31 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:32 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422" returned: 0 in 0.866s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:32 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b916a2-8f67-4beb-b4ed-79cb6a377952]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:32 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:32 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:33 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.927s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:33 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 Jul 11 03:57:33 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:34 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422" returned: 0 in 0.887s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:34 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422 Jul 11 03:57:34 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:34 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.4d449d15-636a-4212-aa8d-1e9e3a857422" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-4d449d15-636a-4212-aa8d-1e9e3a857422" released by "_delete_snapshot" :: held 3.565s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" released by "delete_snapshot" :: held 3.595s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:35 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Created reservations ['fae9cb82-d763-4526-bd9e-a783e837725e', '6b1feec7-ec15-4339-aa64-0cb06faf571d', '3775e986-853e-4e6d-b9af-18fa991ae097', 'c044e503-8374-4766-bc00-44650d067dc9'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Delete snapshot completed successfully. Jul 11 03:57:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-17890684-9b23-4a86-8853-452ede98dc81 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-4d449d15-636a-4212-aa8d-1e9e3a857422-delete_snapshot" released by "delete_snapshot" :: held 3.766s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Creating offline snapshot 657c0cdc-f30b-417f-878f-5cff30666bd0 of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:57:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b7e467-80ff-4ef3-a180-ac02b9711d2b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:36 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:36 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:36 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.983s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:37 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 1G Jul 11 03:57:37 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:38 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 1G" returned: 0 in 1.149s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:38 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 Jul 11 03:57:38 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:38 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0" returned: 0 in 0.773s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:38 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 is being set with open permissions: ugo+rw Jul 11 03:57:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:38 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 Jul 11 03:57:38 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:39 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0" returned: 0 in 0.735s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.770s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:39 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5cc5ce37-cf5e-4420-9e56-b8c66ef18479 tempest-SnapshotsActionsTest-742948443 None] Create snapshot completed successfully Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-657c0cdc-f30b-417f-878f-5cff30666bd0-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-657c0cdc-f30b-417f-878f-5cff30666bd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-657c0cdc-f30b-417f-878f-5cff30666bd0" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-657c0cdc-f30b-417f-878f-5cff30666bd0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Deleting offline snapshot 657c0cdc-f30b-417f-878f-5cff30666bd0 of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] snapshot_file for this snap is: volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cedad4-a967-4da2-bae8-2ac43a502204]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:40 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 Jul 11 03:57:40 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:41 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0" returned: 0 in 1.044s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f18c9d-0abf-4f3d-8810-bfa0c06ed4ed]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:41 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:41 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:42 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.965s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:42 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 Jul 11 03:57:42 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:43 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0" returned: 0 in 0.990s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:43 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0 Jul 11 03:57:43 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:44 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.657c0cdc-f30b-417f-878f-5cff30666bd0" returned: 0 in 0.903s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-657c0cdc-f30b-417f-878f-5cff30666bd0" released by "_delete_snapshot" :: held 4.030s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" released by "delete_snapshot" :: held 4.060s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:44 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Created reservations ['45eefb38-fab5-4988-882e-f0777db42c49', '825c1d72-9fb1-4932-ba24-2650f66ccfa7', '47860129-13e9-4c5a-a8ef-ee8542d3b60c', 'ffe19988-819b-4c66-83d6-c7ad918ca3b6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Delete snapshot completed successfully. Jul 11 03:57:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-39bc3146-efd5-40b7-8c13-848dfe3da1cc tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-657c0cdc-f30b-417f-878f-5cff30666bd0-delete_snapshot" released by "delete_snapshot" :: held 4.327s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-608b9926-24f3-4655-be00-3a35eae541fb tempest-GroupsTest-169068218 None] Group tempest-Group1-340652107: creating Jul 11 03:57:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-608b9926-24f3-4655-be00-3a35eae541fb tempest-GroupsTest-169068218 None] Group tempest-Group1-340652107: created successfully Jul 11 03:57:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-608b9926-24f3-4655-be00-3a35eae541fb tempest-GroupsTest-169068218 None] Create group completed successfully. Jul 11 03:57:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Creating offline snapshot f9290f95-23a5-4d69-9496-6076bbb60f4e of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:57:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc644fa6-68b4-4e61-914e-ef12631da043]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-61dcbd14-f85b-474a-9634-81aba9884405 tempest-GroupsTest-169068218 None] Group tempest-Group2-1205408261: creating Jul 11 03:57:46 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:46 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-61dcbd14-f85b-474a-9634-81aba9884405 tempest-GroupsTest-169068218 None] Group tempest-Group2-1205408261: created successfully Jul 11 03:57:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-61dcbd14-f85b-474a-9634-81aba9884405 tempest-GroupsTest-169068218 None] Create group completed successfully. Jul 11 03:57:46 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.894s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:46 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e 1G Jul 11 03:57:46 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:47 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:47 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=104,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=10 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:57:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e 1G" returned: 0 in 1.031s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:47 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e Jul 11 03:57:47 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:47 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Flow 'volume_create_manager' (b8b4148c-2068-430f-b4b8-ae9797de6744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fab311-1e9c-4d04-9c9a-f579ba10350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5fab311-1e9c-4d04-9c9a-f579ba10350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750898774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e526987a-141d-4f0a-8605-6f69a708567e,host='devstack@QuobyteHD#QuobyteHD',id=af4863b4-cede-435b-9b75-41f012f92e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb1921062384f24b25ad3686af5c2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:48Z,use_quota=True,user_id='e7edda84f50f4af2a7b0aa038d0ba364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34b9646b-ffd1-4b1e-b823-238d2cdede50),volume_type_id=34b9646b-ffd1-4b1e-b823-238d2cdede50)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187e35f7-f0eb-4628-90c0-2372236e5f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187e35f7-f0eb-4628-90c0-2372236e5f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374088d3-84ab-42d2-855f-b410e8857e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (374088d3-84ab-42d2-855f-b410e8857e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4863b4-cede-435b-9b75-41f012f92e6a', 'volume_name': 'volume-af4863b4-cede-435b-9b75-41f012f92e6a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0dd05d-2321-49b7-ad35-63ee765abb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0dd05d-2321-49b7-ad35-63ee765abb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ad2169-8a75-44e6-b7b9-1e7457f5fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Volume af4863b4-cede-435b-9b75-41f012f92e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4863b4-cede-435b-9b75-41f012f92e6a', 'volume_size': 1} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Flow 'volume_create_manager' (fa8aa140-4d77-4f09-b090-d481ac0ed0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64c6fa6-273a-4683-965a-6cc93b70c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64c6fa6-273a-4683-965a-6cc93b70c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1488830163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264a1a01-7df3-4f14-81eb-6eb3afad95c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aae4b355d6143b5b2277bfbfc8ba533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:48Z,use_quota=True,user_id='913a07dc20b546d98e249fce8dc9428c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1514e57-570e-4176-a83e-ca30fd00a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1514e57-570e-4176-a83e-ca30fd00a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d02704-01aa-4c45-9d1d-96e81f31b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d02704-01aa-4c45-9d1d-96e81f31b039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264a1a01-7df3-4f14-81eb-6eb3afad95c6', 'volume_name': 'volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03287c42-b8d4-48f6-b3de-c0bd1d8c3216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03287c42-b8d4-48f6-b3de-c0bd1d8c3216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb3b179-1576-429f-b499-f354c56852f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:48 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Volume 264a1a01-7df3-4f14-81eb-6eb3afad95c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6', 'volume_size': 1} Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:48 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e" returned: 0 in 0.751s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:48 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e is being set with open permissions: ugo+rw Jul 11 03:57:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:48 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e Jul 11 03:57:48 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:49 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e" returned: 0 in 0.642s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=129,cinder:SELECT=78,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e526987a-141d-4f0a-8605-6f69a708567e,created_at=2026-07-11T01:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750898774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e526987a-141d-4f0a-8605-6f69a708567e,host='devstack@QuobyteHD#QuobyteHD',id=af4863b4-cede-435b-9b75-41f012f92e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb1921062384f24b25ad3686af5c2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:48Z,use_quota=True,user_id='e7edda84f50f4af2a7b0aa038d0ba364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34b9646b-ffd1-4b1e-b823-238d2cdede50),volume_type_id=34b9646b-ffd1-4b1e-b823-238d2cdede50)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Creating volume af4863b4-cede-435b-9b75-41f012f92e6a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:49 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:49 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a 1073741824 Jul 11 03:57:49 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-12105910-7173-4772-899c-827af02ab8f4 tempest-SnapshotsActionsTest-742948443 None] Create snapshot completed successfully Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-f9290f95-23a5-4d69-9496-6076bbb60f4e-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:50 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a 1073741824" returned: 0 in 0.893s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-f9290f95-23a5-4d69-9496-6076bbb60f4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-f9290f95-23a5-4d69-9496-6076bbb60f4e" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-f9290f95-23a5-4d69-9496-6076bbb60f4e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Deleting offline snapshot f9290f95-23a5-4d69-9496-6076bbb60f4e of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:57:50 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a Jul 11 03:57:50 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] snapshot_file for this snap is: volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b597677-aa67-4f95-b1e4-2c49566a1839]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:50 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e Jul 11 03:57:50 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:50 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a" returned: 0 in 0.656s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1488830163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264a1a01-7df3-4f14-81eb-6eb3afad95c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aae4b355d6143b5b2277bfbfc8ba533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:48Z,use_quota=True,user_id='913a07dc20b546d98e249fce8dc9428c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Creating volume 264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:50 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02ad2169-8a75-44e6-b7b9-1e7457f5fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4863b4-cede-435b-9b75-41f012f92e6a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:51 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 1073741824 Jul 11 03:57:51 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c550d6e-c31b-4aad-a842-059c4043125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:51 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Volume volume-af4863b4-cede-435b-9b75-41f012f92e6a (af4863b4-cede-435b-9b75-41f012f92e6a): created successfully Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c550d6e-c31b-4aad-a842-059c4043125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Flow 'volume_create_manager' (b8b4148c-2068-430f-b4b8-ae9797de6744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0615bed4-c7b9-4b8b-8466-89cc5a4699e3 tempest-GroupsTest-169068218 None] Created volume successfully. Jul 11 03:57:51 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e" returned: 0 in 0.793s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b9cf87-7943-4651-9e80-de63547e7e77]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:51 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:51 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:51 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 1073741824" returned: 0 in 0.919s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:51 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:57:51 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:52 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.832s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:52 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e Jul 11 03:57:52 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Acquiring lock "cinder-quobyte-af4863b4-cede-435b-9b75-41f012f92e6a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Lock "cinder-quobyte-af4863b4-cede-435b-9b75-41f012f92e6a" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b9f38-02de-4883-b23b-a21c6c538d01]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:52 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a Jul 11 03:57:52 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:52 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.708s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb3b179-1576-429f-b499-f354c56852f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53901f77-e6f7-4d0d-82f9-2633f42aedb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:52 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Volume volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 (264a1a01-7df3-4f14-81eb-6eb3afad95c6): created successfully Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53901f77-e6f7-4d0d-82f9-2633f42aedb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Flow 'volume_create_manager' (fa8aa140-4d77-4f09-b090-d481ac0ed0dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5a42b82d-a98d-4180-bc0d-f4915fa68fe7 tempest-VolumesActionsTest-2087133683 None] Created volume successfully. Jul 11 03:57:52 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e" returned: 0 in 0.831s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:52 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e Jul 11 03:57:52 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:53 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a" returned: 0 in 0.840s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:53 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a Jul 11 03:57:53 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:53 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.f9290f95-23a5-4d69-9496-6076bbb60f4e" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-f9290f95-23a5-4d69-9496-6076bbb60f4e" released by "_delete_snapshot" :: held 3.319s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" released by "delete_snapshot" :: held 3.353s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Created reservations ['ebf13981-8811-47a3-beae-6429f7ed47ec', 'ccaa8a9a-d996-4205-a38a-54d04573ecfc', '3fdcd966-4494-4638-8a18-721b2ea6b21e', '68f9b84e-966a-441c-bb2d-3a938fce5e4e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:53 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af4863b4-cede-435b-9b75-41f012f92e6a" returned: 0 in 0.707s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Lock "cinder-quobyte-af4863b4-cede-435b-9b75-41f012f92e6a" released by "delete_volume" :: held 1.614s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Delete snapshot completed successfully. Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e1ff4467-4f84-498d-81c6-4554a3c1f765 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-f9290f95-23a5-4d69-9496-6076bbb60f4e-delete_snapshot" released by "delete_snapshot" :: held 3.570s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Created reservations ['e033ee9e-4811-4c0f-a368-e0ccb4177187'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:53 devstack cinder-volume[87437]: WARNING cinder.quota [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1621237258 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1621237258, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:57:53 devstack cinder-volume[87437]: WARNING cinder.quota [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1621237258 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1621237258, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:57:53 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Created reservations ['24bacf7b-24b6-44e6-b278-5d882ceb5ad4', '428a0b3a-d7b9-40c6-b8f7-bcc4d4701bfc', 'ce3f4428-5de4-4d44-ac2f-b8e599881c94', '2a7a81f8-ce83-4f72-b44f-be454304e938'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:54 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:54 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:54 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.724s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:54 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f3bf31d4-d355-4d14-a9f6-81bf93774089 tempest-GroupsTest-169068218 None] Delete group completed successfully. Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Created reservations ['585a0a61-0c6e-46d1-8425-41d350e72ae0'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:54 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:57:54 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Creating offline snapshot 92facb80-c4b6-4d78-b7c6-45f2fb755bfc of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2abc0d0-f691-4522-964d-50f332dca9f4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:55 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:57:55 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:55 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:57:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6eabea17-37d2-48bf-b85c-d3154a27541a tempest-GroupsTest-169068218 None] Delete group completed successfully. Jul 11 03:57:55 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.807s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:57:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:55 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc 1G Jul 11 03:57:55 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-babd283c-b5fb-47bf-ada1-0cc20c563aa5 tempest-GroupsTest-169068218 None] Group tempest-GroupsTest-Group-1016038766: creating Jul 11 03:57:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-babd283c-b5fb-47bf-ada1-0cc20c563aa5 tempest-GroupsTest-169068218 None] Group tempest-GroupsTest-Group-1016038766: created successfully Jul 11 03:57:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-babd283c-b5fb-47bf-ada1-0cc20c563aa5 tempest-GroupsTest-169068218 None] Create group completed successfully. Jul 11 03:57:56 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc 1G" returned: 0 in 0.859s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:56 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc Jul 11 03:57:56 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:57 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:57 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc is being set with open permissions: ugo+rw Jul 11 03:57:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:57 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc Jul 11 03:57:57 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Flow 'volume_create_manager' (12715556-050d-484c-84fc-3654a894252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86318eb7-0ae1-43f7-8e33-a197e13256d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86318eb7-0ae1-43f7-8e33-a197e13256d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1045864626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a4d3977-5e29-40b6-ada7-4c39d48d9730,host='devstack@QuobyteHD#QuobyteHD',id=580100ab-3194-4319-8f6c-286d811312aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb1921062384f24b25ad3686af5c2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:58Z,use_quota=True,user_id='e7edda84f50f4af2a7b0aa038d0ba364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1a7a50-f924-415b-ada3-cb03eeead64a),volume_type_id=ee1a7a50-f924-415b-ada3-cb03eeead64a)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad1302-e2c4-4ad5-9698-98a6a18ec226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ad1302-e2c4-4ad5-9698-98a6a18ec226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eda4143-4eca-479b-9b2e-7a30d9eb00d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:58 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eda4143-4eca-479b-9b2e-7a30d9eb00d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580100ab-3194-4319-8f6c-286d811312aa', 'volume_name': 'volume-580100ab-3194-4319-8f6c-286d811312aa', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e59ac8e-f2bf-4106-9fac-78655fccd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e59ac8e-f2bf-4106-9fac-78655fccd222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee6c2f-dd89-492d-9de5-52c68b2b6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Volume 580100ab-3194-4319-8f6c-286d811312aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580100ab-3194-4319-8f6c-286d811312aa', 'volume_size': 1} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.222s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a4d3977-5e29-40b6-ada7-4c39d48d9730,created_at=2026-07-11T01:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1045864626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a4d3977-5e29-40b6-ada7-4c39d48d9730,host='devstack@QuobyteHD#QuobyteHD',id=580100ab-3194-4319-8f6c-286d811312aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb1921062384f24b25ad3686af5c2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:57:58Z,use_quota=True,user_id='e7edda84f50f4af2a7b0aa038d0ba364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1a7a50-f924-415b-ada3-cb03eeead64a),volume_type_id=ee1a7a50-f924-415b-ada3-cb03eeead64a)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Creating volume 580100ab-3194-4319-8f6c-286d811312aa {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:57:58 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:57:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:58 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa 1073741824 Jul 11 03:57:58 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d655d17e-f28a-4f6d-904e-c30d2f433282 tempest-SnapshotsActionsTest-742948443 None] Create snapshot completed successfully Jul 11 03:57:59 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa 1073741824" returned: 0 in 0.821s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:59 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa Jul 11 03:57:59 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-92facb80-c4b6-4d78-b7c6-45f2fb755bfc-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-92facb80-c4b6-4d78-b7c6-45f2fb755bfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Acquiring lock "cinder-quobyte-92facb80-c4b6-4d78-b7c6-45f2fb755bfc" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-92facb80-c4b6-4d78-b7c6-45f2fb755bfc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Deleting offline snapshot 92facb80-c4b6-4d78-b7c6-45f2fb755bfc of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] snapshot_file for this snap is: volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b7ebd-b75a-4c2a-a36d-21ac96360582]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:57:59 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc Jul 11 03:57:59 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:57:59 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa" returned: 0 in 0.783s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee6c2f-dd89-492d-9de5-52c68b2b6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580100ab-3194-4319-8f6c-286d811312aa', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782522c4-d858-4c71-bb77-3af5925f7f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:57:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Volume volume-580100ab-3194-4319-8f6c-286d811312aa (580100ab-3194-4319-8f6c-286d811312aa): created successfully Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782522c4-d858-4c71-bb77-3af5925f7f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:57:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Flow 'volume_create_manager' (12715556-050d-484c-84fc-3654a894252a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:57:59 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-66e3b113-1256-4768-9ea9-c10a9031ecbd tempest-GroupsTest-169068218 None] Created volume successfully. Jul 11 03:58:00 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc" returned: 0 in 0.938s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:58:00 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[42be2c48-b6fd-4dcf-bf77-1301cf196263]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:00 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:58:00 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Flow 'volume_create_manager' (5e78d37c-6917-469d-a3b6-ac41ddef23a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f168f7-93b1-4417-88d0-1e431fa114d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f168f7-93b1-4417-88d0-1e431fa114d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953689603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a4d3977-5e29-40b6-ada7-4c39d48d9730,host='devstack@QuobyteHD#QuobyteHD',id=05af88f7-44e4-4f17-8fc7-0d0a3207a853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb1921062384f24b25ad3686af5c2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:01Z,use_quota=True,user_id='e7edda84f50f4af2a7b0aa038d0ba364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1a7a50-f924-415b-ada3-cb03eeead64a),volume_type_id=ee1a7a50-f924-415b-ada3-cb03eeead64a)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31e1065-15a4-4718-b09d-1bfda5397db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31e1065-15a4-4718-b09d-1bfda5397db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005bb9c9-9ae1-4ed8-aaaa-1f50b1ea6985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005bb9c9-9ae1-4ed8-aaaa-1f50b1ea6985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05af88f7-44e4-4f17-8fc7-0d0a3207a853', 'volume_name': 'volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86913a1d-7392-4e4f-8bde-8c9eab1ae6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86913a1d-7392-4e4f-8bde-8c9eab1ae6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a79ab8a-66d5-4ebb-ad40-d87279a9e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Volume 05af88f7-44e4-4f17-8fc7-0d0a3207a853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853', 'volume_size': 1} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a4d3977-5e29-40b6-ada7-4c39d48d9730,created_at=2026-07-11T01:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-953689603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a4d3977-5e29-40b6-ada7-4c39d48d9730,host='devstack@QuobyteHD#QuobyteHD',id=05af88f7-44e4-4f17-8fc7-0d0a3207a853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb1921062384f24b25ad3686af5c2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:01Z,use_quota=True,user_id='e7edda84f50f4af2a7b0aa038d0ba364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1a7a50-f924-415b-ada3-cb03eeead64a),volume_type_id=ee1a7a50-f924-415b-ada3-cb03eeead64a)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Creating volume 05af88f7-44e4-4f17-8fc7-0d0a3207a853 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:58:01 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:01 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 1073741824 Jul 11 03:58:01 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:01 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.965s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:58:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:01 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc Jul 11 03:58:01 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:02 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 1073741824" returned: 0 in 0.985s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:02 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc" returned: 0 in 0.824s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:02 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc Jul 11 03:58:02 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:02 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 Jul 11 03:58:02 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:02 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.92facb80-c4b6-4d78-b7c6-45f2fb755bfc" returned: 0 in 0.666s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-92facb80-c4b6-4d78-b7c6-45f2fb755bfc" released by "_delete_snapshot" :: held 3.544s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" released by "delete_snapshot" :: held 3.570s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:02 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853" returned: 0 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a79ab8a-66d5-4ebb-ad40-d87279a9e94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016a4595-a4e0-49a0-80c8-09816a0122aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Volume volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 (05af88f7-44e4-4f17-8fc7-0d0a3207a853): created successfully Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016a4595-a4e0-49a0-80c8-09816a0122aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Flow 'volume_create_manager' (5e78d37c-6917-469d-a3b6-ac41ddef23a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f0caab91-69a6-42dd-b2b1-d07dd47bb9ea tempest-GroupsTest-169068218 None] Created volume successfully. Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Created reservations ['477be521-d802-4ebe-90c7-335d865fe45e', '65343b6e-8d1f-4fbe-a69d-cec96471e219', 'c228609b-5b70-4174-b959-09926872e967', '74f42e62-99a0-4e9b-8952-211f94c521b1'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Delete snapshot completed successfully. Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a09f47c2-33bb-45a5-85c9-862c849d19d8 tempest-SnapshotsActionsTest-539547625 None] Lock "cinder-92facb80-c4b6-4d78-b7c6-45f2fb755bfc-delete_snapshot" released by "delete_snapshot" :: held 3.754s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dd059453-1a2a-4800-af4c-e2074efa940a tempest-GroupsTest-169068218 None] Update group completed successfully. Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "cinder-1bb25a80-736f-4759-8619-b8e74427fc0f-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-1bb25a80-736f-4759-8619-b8e74427fc0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "cinder-quobyte-1bb25a80-736f-4759-8619-b8e74427fc0f" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-quobyte-1bb25a80-736f-4759-8619-b8e74427fc0f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Deleting offline snapshot 1bb25a80-736f-4759-8619-b8e74427fc0f of volume 9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] snapshot_file for this snap is: volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2bfb3e-8900-422a-95cc-5d982eaf7398]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:04 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:58:04 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:04 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.884s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9755a21c-21b1-42e4-b3a0-ee6b32747087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:58:05 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6185983c-505e-42d4-88d4-099f2248b1dc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:05 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 Jul 11 03:58:05 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1701b37b-ad36-433d-ba93-b929c9c8fc9e tempest-GroupsTest-169068218 None] Update group completed successfully. Jul 11 03:58:05 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087" returned: 0 in 0.962s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:06 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:58:06 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:06 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.953s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Acquiring lock "cinder-quobyte-05af88f7-44e4-4f17-8fc7-0d0a3207a853" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Lock "cinder-quobyte-05af88f7-44e4-4f17-8fc7-0d0a3207a853" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:06 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f Jul 11 03:58:06 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91552cb-1108-4b86-84c1-19a1e116dc1c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:07 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 Jul 11 03:58:07 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:07 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087.1bb25a80-736f-4759-8619-b8e74427fc0f" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-quobyte-1bb25a80-736f-4759-8619-b8e74427fc0f" released by "_delete_snapshot" :: held 3.675s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" released by "delete_snapshot" :: held 3.701s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Created reservations ['b3e7b489-5c88-4bcc-b510-daf3c5102d4e', 'ea186914-3bcc-4a37-9454-fd8cc233c4f5', '95d81b7d-c795-4e6f-9608-2763f51c1fdb', '8445d0f4-7ff1-4ebd-aa81-c634d4ccc4d8'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Delete snapshot completed successfully. Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-460fe0a2-c5bf-431e-bff7-1b3df7ac7a9b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-1bb25a80-736f-4759-8619-b8e74427fc0f-delete_snapshot" released by "delete_snapshot" :: held 3.837s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:07 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853" returned: 0 in 0.865s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:07 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853 Jul 11 03:58:07 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "cinder-9755a21c-21b1-42e4-b3a0-ee6b32747087-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-9755a21c-21b1-42e4-b3a0-ee6b32747087-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf160ad-cd04-44d1-83f5-5eda186aae65]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:08 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 Jul 11 03:58:08 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:08 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05af88f7-44e4-4f17-8fc7-0d0a3207a853" returned: 0 in 0.846s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Lock "cinder-quobyte-05af88f7-44e4-4f17-8fc7-0d0a3207a853" released by "delete_volume" :: held 1.764s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Acquiring lock "cinder-quobyte-580100ab-3194-4319-8f6c-286d811312aa" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Lock "cinder-quobyte-580100ab-3194-4319-8f6c-286d811312aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae41c4-b54f-4e19-b9ff-874dffda3bfa]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:08 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa Jul 11 03:58:08 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:09 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087" returned: 0 in 0.916s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:09 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087 Jul 11 03:58:09 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8e18db6c-57a9-40ec-9588-d7d5e6918613 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6" by "attach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8e18db6c-57a9-40ec-9588-d7d5e6918613 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6" acquired by "attach_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:09 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa" returned: 0 in 0.997s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8e18db6c-57a9-40ec-9588-d7d5e6918613 tempest-VolumesActionsTest-2087133683 None] Attaching volume 264a1a01-7df3-4f14-81eb-6eb3afad95c6 to instance 494a1de3-c18b-45c5-a1ba-1d24af16f88f at mountpoint /dev/vdb on host None. Jul 11 03:58:09 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa Jul 11 03:58:09 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8e18db6c-57a9-40ec-9588-d7d5e6918613 tempest-VolumesActionsTest-2087133683 None] Attach volume completed successfully. Jul 11 03:58:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8e18db6c-57a9-40ec-9588-d7d5e6918613 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6" released by "attach_volume" :: held 0.139s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:10 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9755a21c-21b1-42e4-b3a0-ee6b32747087" returned: 0 in 0.855s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-75abb28d-2447-4b5a-befd-f2474fe3cab0 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-detach_volume" by "detach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-quobyte-9755a21c-21b1-42e4-b3a0-ee6b32747087" released by "delete_volume" :: held 1.893s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-75abb28d-2447-4b5a-befd-f2474fe3cab0 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:10 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-75abb28d-2447-4b5a-befd-f2474fe3cab0 tempest-VolumesActionsTest-2087133683 None] Detaching volume 264a1a01-7df3-4f14-81eb-6eb3afad95c6 from instance 494a1de3-c18b-45c5-a1ba-1d24af16f88f. Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Created reservations ['821f3b8c-b0ef-432c-8fe2-bafa622473e5', '81a78cc5-a332-414e-9ff7-dcaa50c9a5f2', '39cc2b3d-cc90-4d93-86a3-4a48054835ee', '95056621-b17f-4ed6-9f4e-d6650ef18883'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:10 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-75abb28d-2447-4b5a-befd-f2474fe3cab0 tempest-VolumesActionsTest-2087133683 None] Detach volume completed successfully. Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-75abb28d-2447-4b5a-befd-f2474fe3cab0 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:10 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-580100ab-3194-4319-8f6c-286d811312aa" returned: 0 in 0.704s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Lock "cinder-quobyte-580100ab-3194-4319-8f6c-286d811312aa" released by "delete_volume" :: held 1.772s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:10 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:10 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Created reservations ['b0a5c5be-4e6b-4e2e-875d-ba4c2182b653'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:10 devstack cinder-volume[87437]: WARNING cinder.quota [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-420458373 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-420458373, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:58:10 devstack cinder-volume[87437]: WARNING cinder.quota [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-420458373 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-420458373, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Created reservations ['dbee157c-c660-4718-8084-048c4a31052e', 'c25cbb50-cec8-49b0-9164-5b25ba151401', '8c74f753-abd9-4d17-b57e-d872e8d4d24e', 'efd3c74b-1b09-47a8-a741-6aed7b1b4088'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Created reservations ['f4660ea3-08bb-4a2b-a58c-03b2e62e42d4', 'a92c7084-d141-4f05-b6a1-28f7779a1ab0', '29957d1f-0db9-4e53-afa5-46b6dc9732ba', 'e960c4fe-d7e4-407b-b4ab-a8e8fcf6d316'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:11 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:11 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:11 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.015s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:11 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Deleted volume successfully. Jul 11 03:58:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-601994af-0780-4849-8c29-b9e92f17e74b tempest-SnapshotsActionsTest-742948443 None] Lock "cinder-9755a21c-21b1-42e4-b3a0-ee6b32747087-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:12 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.023s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-76f4b334-0f07-4e93-a57c-d232edb4e867 tempest-GroupsTest-169068218 None] Delete group completed successfully. Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:14 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:14 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:14 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.891s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:15 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:58:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:58:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:58:20 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=70,cinder:UPDATE=80,cinder:DELETE=3,cinder:INSERT=23 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:58:21 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=67,cinder:UPDATE=69,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Flow 'volume_create_manager' (e94d8f66-3f3a-474c-be9c-c881da603891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b4e8b-bf88-42b6-8858-e5bc94b3bca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b4e8b-bf88-42b6-8858-e5bc94b3bca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1633209919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9fff4b-7eb2-4e97-acf2-bc64f13214ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca7019af9c84689a059613fc91621da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:25Z,use_quota=True,user_id='8ba2d9c73f3941568c11218e0fc99b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72c27083-d182-468d-96de-7d17c21867c4),volume_type_id=72c27083-d182-468d-96de-7d17c21867c4)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a552229-35da-444e-a622-4a582d7a15ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a552229-35da-444e-a622-4a582d7a15ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f12478f-41cb-4bfa-9d53-d8ba018eed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f12478f-41cb-4bfa-9d53-d8ba018eed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9fff4b-7eb2-4e97-acf2-bc64f13214ad', 'volume_name': 'volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e065aed-dbb3-4ee1-9194-e04e059f9988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e065aed-dbb3-4ee1-9194-e04e059f9988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c410a04-dd95-4ae4-bacd-076096b8213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:25 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Volume 3c9fff4b-7eb2-4e97-acf2-bc64f13214ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad', 'volume_size': 1} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1633209919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9fff4b-7eb2-4e97-acf2-bc64f13214ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca7019af9c84689a059613fc91621da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:25Z,use_quota=True,user_id='8ba2d9c73f3941568c11218e0fc99b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72c27083-d182-468d-96de-7d17c21867c4),volume_type_id=72c27083-d182-468d-96de-7d17c21867c4)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Creating volume 3c9fff4b-7eb2-4e97-acf2-bc64f13214ad {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:58:25 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:58:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:25 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad 1073741824 Jul 11 03:58:25 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:26 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad 1073741824" returned: 0 in 1.071s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:26 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad Jul 11 03:58:26 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:26 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad" returned: 0 in 0.842s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:58:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c410a04-dd95-4ae4-bacd-076096b8213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de88dcd4-302a-4f28-a11f-3452a0fcadde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:27 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Volume volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad (3c9fff4b-7eb2-4e97-acf2-bc64f13214ad): created successfully Jul 11 03:58:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de88dcd4-302a-4f28-a11f-3452a0fcadde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Flow 'volume_create_manager' (e94d8f66-3f3a-474c-be9c-c881da603891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-193a7e71-d8ba-4b7f-abe6-559b7d08144b tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Created volume successfully. Jul 11 03:58:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:28 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:28 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:29 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b70d7373-f6fa-4e5f-a052-de6fa047fa99 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Retype volume completed successfully. Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Acquiring lock "cinder-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "cinder-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Acquiring lock "cinder-quobyte-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "cinder-quobyte-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a389f7f-9e03-4413-8c6b-0921ca953012]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:30 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad Jul 11 03:58:30 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:30 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad" returned: 0 in 1.031s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:31 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad Jul 11 03:58:31 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:31 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad" returned: 0 in 0.887s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "cinder-quobyte-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad" released by "delete_volume" :: held 1.975s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:31 devstack cinder-volume[87437]: WARNING cinder.quota [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:58:31 devstack cinder-volume[87437]: WARNING cinder.quota [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:58:31 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Created reservations ['275d56e1-eafd-4d10-b351-b2740f7a7830', '013701ee-eeca-4d5a-b692-599cfe310f0a', '02103687-d138-457c-9960-f006ae792f1e', 'fbe4d5fc-03cc-4556-8f6a-8cd116f6c2f3'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:32 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:32 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:32 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.766s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Deleted volume successfully. Jul 11 03:58:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f240c0c2-5f08-4e9a-98bd-ee043716ce67 tempest-VolumeRetypeWithoutMigrationTest-1044089930 None] Lock "cinder-3c9fff4b-7eb2-4e97-acf2-bc64f13214ad-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Flow 'volume_create_manager' (093f9606-264e-4037-b8a4-26ae3d041256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b53f3d-a6ef-4069-99ea-c242c2c19944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b53f3d-a6ef-4069-99ea-c242c2c19944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-584774460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac895807-78a9-417f-a7bb-e3d435bfc03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c62b877c83c4ab79da0585308ebb608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:33Z,use_quota=True,user_id='0e4c42da315747d1b3e5f002458d404d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb6f302-565a-4dc4-a934-fa6d1b60cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb6f302-565a-4dc4-a934-fa6d1b60cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb4d28b-c04a-4767-ab53-fb32c778f7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb4d28b-c04a-4767-ab53-fb32c778f7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac895807-78a9-417f-a7bb-e3d435bfc03a', 'volume_name': 'volume-ac895807-78a9-417f-a7bb-e3d435bfc03a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dd2490-be1a-46fa-8886-c864f5d9e9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dd2490-be1a-46fa-8886-c864f5d9e9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e2e069-06e1-4351-b76f-f97c382705e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:33 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Volume ac895807-78a9-417f-a7bb-e3d435bfc03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac895807-78a9-417f-a7bb-e3d435bfc03a', 'volume_size': 1} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-584774460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac895807-78a9-417f-a7bb-e3d435bfc03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c62b877c83c4ab79da0585308ebb608',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:33Z,use_quota=True,user_id='0e4c42da315747d1b3e5f002458d404d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Creating volume ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:58:33 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:58:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:33 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a 1073741824 Jul 11 03:58:33 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:34 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a 1073741824" returned: 0 in 1.167s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:34 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a Jul 11 03:58:34 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:35 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a" returned: 0 in 0.911s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e2e069-06e1-4351-b76f-f97c382705e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac895807-78a9-417f-a7bb-e3d435bfc03a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622e836b-5195-429c-8c49-745670dcd1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Volume volume-ac895807-78a9-417f-a7bb-e3d435bfc03a (ac895807-78a9-417f-a7bb-e3d435bfc03a): created successfully Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622e836b-5195-429c-8c49-745670dcd1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Flow 'volume_create_manager' (093f9606-264e-4037-b8a4-26ae3d041256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-44f698ae-1955-401e-8468-cf4241703898 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Created volume successfully. Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a8c0dcde-31c7-497b-9221-7621dccbc931 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6" by "attach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a8c0dcde-31c7-497b-9221-7621dccbc931 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6" acquired by "attach_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a8c0dcde-31c7-497b-9221-7621dccbc931 tempest-VolumesActionsTest-2087133683 None] Attaching volume 264a1a01-7df3-4f14-81eb-6eb3afad95c6 to instance 060e8afa-2f88-435d-a3a5-dc1536e2ba1d at mountpoint /dev/vdb on host None. Jul 11 03:58:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a8c0dcde-31c7-497b-9221-7621dccbc931 tempest-VolumesActionsTest-2087133683 None] Attach volume completed successfully. Jul 11 03:58:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a8c0dcde-31c7-497b-9221-7621dccbc931 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6" released by "attach_volume" :: held 0.104s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-078ed9ef-509e-48c1-8dea-7f309d2c8743 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-detach_volume" by "detach_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-078ed9ef-509e-48c1-8dea-7f309d2c8743 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:36 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-078ed9ef-509e-48c1-8dea-7f309d2c8743 tempest-VolumesActionsTest-2087133683 None] Detaching volume 264a1a01-7df3-4f14-81eb-6eb3afad95c6 from instance 060e8afa-2f88-435d-a3a5-dc1536e2ba1d. Jul 11 03:58:36 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-078ed9ef-509e-48c1-8dea-7f309d2c8743 tempest-VolumesActionsTest-2087133683 None] Detach volume completed successfully. Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-078ed9ef-509e-48c1-8dea-7f309d2c8743 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Creating offline snapshot 8394d1f4-9999-4b33-bea2-962723cfa6ae of volume ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e4d240-7ca1-45d0-9441-1d2645f31bc1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:36 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a Jul 11 03:58:36 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:37 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a" returned: 0 in 0.935s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:37 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae 1G Jul 11 03:58:37 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:38 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae 1G" returned: 0 in 0.996s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac895807-78a9-417f-a7bb-e3d435bfc03a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:38 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac895807-78a9-417f-a7bb-e3d435bfc03a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae Jul 11 03:58:38 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Flow 'volume_create_manager' (d499f99e-c990-4efd-942f-b18da0096e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5559752d-a3e9-4008-a5a8-3a8b235129dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5559752d-a3e9-4008-a5a8-3a8b235129dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-213456964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792d7919-f852-429a-989b-198deeb89354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad35ad334f6443f78fa38fd43f1def81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:39Z,use_quota=True,user_id='4cc78f6526cf4543835ed6bdf56de758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aeb7976-278a-4b2a-8f91-77337664374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aeb7976-278a-4b2a-8f91-77337664374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7c79c1-1d8f-49dc-a6ad-8427854d037f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7c79c1-1d8f-49dc-a6ad-8427854d037f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792d7919-f852-429a-989b-198deeb89354', 'volume_name': 'volume-792d7919-f852-429a-989b-198deeb89354', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b1b867-85c5-4d7b-baab-b9fa0a4e6ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b1b867-85c5-4d7b-baab-b9fa0a4e6ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f965c541-33e0-4b38-8de3-2ce1cc802af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:38 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Volume 792d7919-f852-429a-989b-198deeb89354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792d7919-f852-429a-989b-198deeb89354', 'volume_size': 1} Jul 11 03:58:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:39 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac895807-78a9-417f-a7bb-e3d435bfc03a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae" returned: 0 in 0.902s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:39 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae is being set with open permissions: ugo+rw Jul 11 03:58:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:39 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae Jul 11 03:58:39 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:40 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:40 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info Jul 11 03:58:40 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:41 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:41 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info is being set with open permissions: ugo+rw Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:41 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info Jul 11 03:58:41 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:41 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.info" returned: 0 in 0.651s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.934s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.781s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-213456964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792d7919-f852-429a-989b-198deeb89354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad35ad334f6443f78fa38fd43f1def81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:58:39Z,use_quota=True,user_id='4cc78f6526cf4543835ed6bdf56de758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Creating volume 792d7919-f852-429a-989b-198deeb89354 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:58:41 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:58:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:41 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 1073741824 Jul 11 03:58:41 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d06c7eb4-71e5-4061-8405-df3e89cf1161 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Create snapshot completed successfully Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "cinder-8394d1f4-9999-4b33-bea2-962723cfa6ae-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-8394d1f4-9999-4b33-bea2-962723cfa6ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "cinder-quobyte-ac895807-78a9-417f-a7bb-e3d435bfc03a" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-quobyte-ac895807-78a9-417f-a7bb-e3d435bfc03a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "cinder-quobyte-8394d1f4-9999-4b33-bea2-962723cfa6ae" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:42 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-quobyte-8394d1f4-9999-4b33-bea2-962723cfa6ae" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Deleting offline snapshot 8394d1f4-9999-4b33-bea2-962723cfa6ae of volume ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] snapshot_file for this snap is: volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 1073741824" returned: 0 in 0.903s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e65fb7-a4d9-4443-a2ac-56b2b2df0e1c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:42 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 Jul 11 03:58:42 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:42 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae Jul 11 03:58:42 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:43 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354" returned: 0 in 0.630s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f965c541-33e0-4b38-8de3-2ce1cc802af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792d7919-f852-429a-989b-198deeb89354', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec76f41-6e5e-47cb-8ae5-5fcbfcc2bc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:58:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Volume volume-792d7919-f852-429a-989b-198deeb89354 (792d7919-f852-429a-989b-198deeb89354): created successfully Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec76f41-6e5e-47cb-8ae5-5fcbfcc2bc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Flow 'volume_create_manager' (d499f99e-c990-4efd-942f-b18da0096e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:58:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3795c215-4551-44bf-80c4-86ab0f4c7497 tempest-VolumesServicesTestJSON-78003782 None] Created volume successfully. Jul 11 03:58:43 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae" returned: 0 in 0.787s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac895807-78a9-417f-a7bb-e3d435bfc03a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed62b87-804a-4786-9dbe-3c53cfd9c3ae]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:43 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a Jul 11 03:58:43 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Acquiring lock "cinder-792d7919-f852-429a-989b-198deeb89354-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:44 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a" returned: 0 in 0.798s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Lock "cinder-792d7919-f852-429a-989b-198deeb89354-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:44 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae Jul 11 03:58:44 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Acquiring lock "cinder-quobyte-792d7919-f852-429a-989b-198deeb89354" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Lock "cinder-quobyte-792d7919-f852-429a-989b-198deeb89354" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2995c1-50ac-4f57-bf18-844fb24c75c7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:44 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 Jul 11 03:58:44 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:45 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae" returned: 0 in 0.825s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:45 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae Jul 11 03:58:45 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:45 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354" returned: 0 in 0.836s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:45 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354 Jul 11 03:58:45 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:45 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a.8394d1f4-9999-4b33-bea2-962723cfa6ae" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-quobyte-8394d1f4-9999-4b33-bea2-962723cfa6ae" released by "_delete_snapshot" :: held 3.246s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-quobyte-ac895807-78a9-417f-a7bb-e3d435bfc03a" released by "delete_snapshot" :: held 3.274s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:45 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-792d7919-f852-429a-989b-198deeb89354" returned: 0 in 0.714s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Lock "cinder-quobyte-792d7919-f852-429a-989b-198deeb89354" released by "delete_volume" :: held 1.594s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:45 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Created reservations ['39674e6c-56ad-4f1e-94ec-25a36dd3e628', '9f113130-f693-4dc3-838d-d0a70648dff7', '2ead2990-f24c-4768-ac84-c56f033b46b5', '968953b5-0f8f-4897-9167-7c635dc32f80'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Delete snapshot completed successfully. Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df4ef33f-9d58-472f-9223-bd3a8dc9cc58 tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-8394d1f4-9999-4b33-bea2-962723cfa6ae-delete_snapshot" released by "delete_snapshot" :: held 3.439s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Created reservations ['f3a63a97-d43c-408f-817d-3c07c31661c4', 'dbbca2b2-cd92-4591-b74b-f5efff145852', '1735f804-376c-4e08-82b0-a5e863a9d342', 'bef4b537-7601-478e-b4e0-c09d94e141e6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:46 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:46 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1fe475-2efe-487c-b859-8d87e50b26cc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:46 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:58:46 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:46 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Deleted volume successfully. Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-12fa21ca-507b-4dc4-8ddb-d8c45ff93fac tempest-VolumesServicesTestJSON-78003782 None] Lock "cinder-792d7919-f852-429a-989b-198deeb89354-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "cinder-ac895807-78a9-417f-a7bb-e3d435bfc03a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-ac895807-78a9-417f-a7bb-e3d435bfc03a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "cinder-quobyte-ac895807-78a9-417f-a7bb-e3d435bfc03a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:58:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-quobyte-ac895807-78a9-417f-a7bb-e3d435bfc03a" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93515fa-f677-4299-92e4-91525b878ed9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:47 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a Jul 11 03:58:47 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:47 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.846s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7da5a0-de95-44c8-b508-c8a365099db4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:47 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:58:47 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:47 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a" returned: 0 in 0.838s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:47 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a Jul 11 03:58:47 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:48 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.861s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.ac79d659-d3d5-47d7-acde-2c4ce4f4f71bch9l7nx1.img {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:48 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.ac79d659-d3d5-47d7-acde-2c4ce4f4f71bch9l7nx1.img Jul 11 03:58:48 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:48 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ac895807-78a9-417f-a7bb-e3d435bfc03a" returned: 0 in 0.786s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-quobyte-ac895807-78a9-417f-a7bb-e3d435bfc03a" released by "delete_volume" :: held 1.703s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Created reservations ['20783810-ad1f-4f89-bd65-b12664a81936', '1f2f8eb7-37ea-4e2f-b451-83d11d442150', 'cc867bd0-1a72-482e-b2f9-9ae5bf6de4af', '6e5f2a5b-b959-48ad-8a5b-90d2bdbd3592'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:58:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:48 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:58:48 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:50 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.537s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:50 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:58:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Deleted volume successfully. Jul 11 03:58:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a26f0e70-1017-4fc0-b791-903357714cda tempest-VolumeSnapshotQuotasNegativeTestJSON-523067737 None] Lock "cinder-ac895807-78a9-417f-a7bb-e3d435bfc03a-delete_volume" released by "delete_volume" :: held 3.561s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:58:54 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.ac79d659-d3d5-47d7-acde-2c4ce4f4f71bch9l7nx1.img" returned: 0 in 5.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[667cdcae-8268-49b9-8e7a-61b3816a1911]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:58:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:58:54 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:58:54 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:58:55 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 11 03:58:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 1.039s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:58:55 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.ac79d659-d3d5-47d7-acde-2c4ce4f4f71bch9l7nx1.img {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:58:55 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Converted 1024.00 MB image at 177.91 MB/s Jul 11 03:58:55 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] ac79d659-d3d5-47d7-acde-2c4ce4f4f71b was raw, no need to convert to raw {{(pid=87437) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1161}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Flow 'volume_create_manager' (8e930be7-fccc-4a09-81c2-49c5d0e7fc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e046a4da-db01-40e1-8c31-a7e1110aff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e046a4da-db01-40e1-8c31-a7e1110aff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1877885431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbadc8f-b53f-4e94-b0c4-5b8d27876481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31f1cb776684680b2ed83f335acb926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:00Z,use_quota=True,user_id='cdb8c6f0310c4f8992912d9b42d5760b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3acc41d-9482-4fa1-8f5e-248853ce1dbf),volume_type_id=f3acc41d-9482-4fa1-8f5e-248853ce1dbf)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9187c310-6b4f-4495-9a6d-e7daed2fd3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9187c310-6b4f-4495-9a6d-e7daed2fd3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477ac5ed-de53-4b8f-a108-1f73552b3e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477ac5ed-de53-4b8f-a108-1f73552b3e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cbadc8f-b53f-4e94-b0c4-5b8d27876481', 'volume_name': 'volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d73729-c2d6-4554-a5e8-0755544da3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d73729-c2d6-4554-a5e8-0755544da3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c6269e-d2d5-4abf-aa4f-bd1152948991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Volume 9cbadc8f-b53f-4e94-b0c4-5b8d27876481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481', 'volume_size': 1} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Flow 'volume_create_manager' (1e71f9a8-b9f1-4425-819c-9edcecf33f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee31b97a-4746-4b19-afdb-8330ae4f8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee31b97a-4746-4b19-afdb-8330ae4f8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-76882418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52be864-e831-4364-b756-e35982b9839e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef12795cc3840528e7dfeffa8b16af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:01Z,use_quota=True,user_id='dcfb8a6899054123938d419471ce7455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98479aa7-8a02-4f92-ada2-945af96e909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98479aa7-8a02-4f92-ada2-945af96e909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed27a86-c286-48c3-b728-aef4c505c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:00 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed27a86-c286-48c3-b728-aef4c505c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a52be864-e831-4364-b756-e35982b9839e', 'volume_name': 'volume-a52be864-e831-4364-b756-e35982b9839e', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fca1d2-6ab2-4643-94c0-b33e3fe0dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fca1d2-6ab2-4643-94c0-b33e3fe0dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e84464-8285-4b12-b801-2e19c7d6f87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Volume a52be864-e831-4364-b756-e35982b9839e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a52be864-e831-4364-b756-e35982b9839e', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Trying to clone a52be864-e831-4364-b756-e35982b9839e from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 03:59:01 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Image download 20.69 MB at 20.69 MB/s Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e0c0d9-b020-4418-8acf-864235af6f7c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:01 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD Jul 11 03:59:01 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:02 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:02 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 is fetched for user dcfb8a6899054123938d419471ce7455. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 03:59:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0049a052-832e-480a-972b-9814a388407e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:02 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD Jul 11 03:59:02 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:03 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:08 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-8702acd6-d280-4099-b8a6-4ebc38cad9ec req-81e57984-50c6-4c4e-ac2b-6b4a7b05c9b0 tempest-ServerActionsTestOtherA-1307395732 None] Terminate volume connection completed successfully. Jul 11 03:59:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-8702acd6-d280-4099-b8a6-4ebc38cad9ec req-81e57984-50c6-4c4e-ac2b-6b4a7b05c9b0 tempest-ServerActionsTestOtherA-1307395732 None] Deleting attachment e4dbbba0-d027-4c49-8d09-7277c7da49ae. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:14 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:14 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:14 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.647s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 03:59:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.872s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Uploaded volume to glance image-id: ac79d659-d3d5-47d7-acde-2c4ce4f4f71b. {{(pid=87437) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.215s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1877885431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cbadc8f-b53f-4e94-b0c4-5b8d27876481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d31f1cb776684680b2ed83f335acb926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:00Z,use_quota=True,user_id='cdb8c6f0310c4f8992912d9b42d5760b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3acc41d-9482-4fa1-8f5e-248853ce1dbf),volume_type_id=f3acc41d-9482-4fa1-8f5e-248853ce1dbf)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Creating volume 9cbadc8f-b53f-4e94-b0c4-5b8d27876481 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:16 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:16 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 1073741824 Jul 11 03:59:16 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7443500a-9263-4b13-9037-a7513d5feb7c tempest-VolumesActionsTest-2087133683 None] Copy volume to image completed successfully. Jul 11 03:59:17 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 1073741824" returned: 0 in 0.881s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:17 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 Jul 11 03:59:17 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:18 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481" returned: 0 in 0.656s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.963s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-76882418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52be864-e831-4364-b756-e35982b9839e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef12795cc3840528e7dfeffa8b16af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:01Z,use_quota=True,user_id='dcfb8a6899054123938d419471ce7455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Creating volume a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:18 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:18 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e 1073741824 Jul 11 03:59:18 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c6269e-d2d5-4abf-aa4f-bd1152948991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fc3e32-08a2-4d0b-80ad-d911df0f0b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Volume volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 (9cbadc8f-b53f-4e94-b0c4-5b8d27876481): created successfully Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fc3e32-08a2-4d0b-80ad-d911df0f0b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Flow 'volume_create_manager' (8e930be7-fccc-4a09-81c2-49c5d0e7fc7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-42539d78-25aa-4f53-9e88-5fe9f53af1a5 tempest-VolumeTypesAccessTest-1866353659 None] Created volume successfully. Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Acquiring lock "cinder-9cbadc8f-b53f-4e94-b0c4-5b8d27876481-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Lock "cinder-9cbadc8f-b53f-4e94-b0c4-5b8d27876481-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Acquiring lock "cinder-quobyte-9cbadc8f-b53f-4e94-b0c4-5b8d27876481" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Lock "cinder-quobyte-9cbadc8f-b53f-4e94-b0c4-5b8d27876481" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[766f39f6-2e02-44d0-b37b-95ad0bb450e1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:18 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 Jul 11 03:59:18 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:18 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e 1073741824" returned: 0 in 0.841s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:18 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:18 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:19 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481" returned: 0 in 0.804s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:19 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481 Jul 11 03:59:19 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:19 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 0 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.396s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b853d9-35c4-44e0-a6c9-b0e9758f6b50]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Attempting download of 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume a52be864-e831-4364-b756-e35982b9839e. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[588dcc71-aa46-4fc3-910e-f063df2aa4a0]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_ {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:19 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:59:19 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:19 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_ Jul 11 03:59:19 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:20 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9cbadc8f-b53f-4e94-b0c4-5b8d27876481" returned: 0 in 0.691s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Lock "cinder-quobyte-9cbadc8f-b53f-4e94-b0c4-5b8d27876481" released by "delete_volume" :: held 1.546s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:20 devstack cinder-volume[87437]: WARNING cinder.quota [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2101311055 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2101311055, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:59:20 devstack cinder-volume[87437]: WARNING cinder.quota [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2101311055 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2101311055, it is now deprecated. Please use the default quota class for default quota. Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Created reservations ['2928db2c-03df-4a52-88d3-8d4e9e307f6b', '49aa6f2f-322d-48c1-9f86-d64d85fcb524', '7af2417e-fc8c-485f-8192-b58686cfccf8', '4a021c2a-4b98-4147-ac79-bca081d5d829'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:20 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:20 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:20 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.774s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84022e3-9cae-4ba2-8da4-8c60146d3d71]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:20 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_" returned: 0 in 0.787s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_ {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:20 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:59:20 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:20 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_ Jul 11 03:59:20 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:20 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Deleted volume successfully. Jul 11 03:59:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-766c3203-d2a5-4a18-a272-85567a7fccfe tempest-VolumeTypesAccessTest-1866353659 None] Lock "cinder-9cbadc8f-b53f-4e94-b0c4-5b8d27876481-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:21 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.895s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:21 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img Jul 11 03:59:21 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:21 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_" returned: 1 in 0.851s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_b6w1kje_' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 03:59:21 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f582c507-a9fa-4d34-b177-df35c118fb7c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:21 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD Jul 11 03:59:21 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:22 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD" returned: 0 in 0.941s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:22 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] 80fd31bb-c6c3-4f44-9f5f-61edc167e142 was qcow2, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 03:59:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:22 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:22 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:26 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 0 in 4.532s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:26 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_i6z0lgs9devstack@QuobyteHD, size 112.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:59:26 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Converted 112.00 MB image at 24.70 MB/s Jul 11 03:59:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:26 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e 1G Jul 11 03:59:26 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:27 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img" returned: 0 in 5.702s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dfcf58-4afe-4c5c-b00e-28ed3be07f3e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:27 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:59:27 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:27 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e 1G" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa362378-5f55-48dc-bbbf-7add3241f6b4]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:27 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:27 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:28 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 1.038s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:59:28 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Converted 1024.00 MB image at 179.54 MB/s Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=60,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=66,cinder:SELECT=56,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] 28f4e37a-6998-4e50-88d7-30857ed5f469 was raw, converting to qcow2 {{(pid=87437) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1178}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fac85e-bb41-4643-a5e6-bc4046353188]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:28 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img Jul 11 03:59:28 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:28 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 0 in 0.813s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:28 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:28 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:28 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img" returned: 0 in 0.735s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:28 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img Jul 11 03:59:28 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:29 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 1 in 0.797s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Downloaded image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume a52be864-e831-4364-b756-e35982b9839e successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 for user dcfb8a6899054123938d419471ce7455 is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Marking volume a52be864-e831-4364-b756-e35982b9839e as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Copying metadata from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 to a52be864-e831-4364-b756-e35982b9839e. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Creating volume glance metadata for volume a52be864-e831-4364-b756-e35982b9839e backed by image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e84464-8285-4b12-b801-2e19c7d6f87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52be864-e831-4364-b756-e35982b9839e', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788f6157-5310-48ea-b004-d8fd6808a125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:29 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Volume volume-a52be864-e831-4364-b756-e35982b9839e (a52be864-e831-4364-b756-e35982b9839e): created successfully Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788f6157-5310-48ea-b004-d8fd6808a125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Flow 'volume_create_manager' (1e71f9a8-b9f1-4425-819c-9edcecf33f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-380c2b5d-7faf-4529-bdad-9546da162163 tempest-VolumesImageMetadata-224261644 None] Created volume successfully. Jul 11 03:59:29 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img" returned: 1 in 0.750s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 03:59:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:29 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph Jul 11 03:59:29 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Acquiring lock "cinder-a52be864-e831-4364-b756-e35982b9839e-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Lock "cinder-a52be864-e831-4364-b756-e35982b9839e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:30 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph" returned: 0 in 0.696s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Image conversion details: src /opt/stack/data/cinder/conversion/264a1a01-7df3-4f14-81eb-6eb3afad95c6.temp_image.28f4e37a-6998-4e50-88d7-30857ed5f469ui7pj6dn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 03:59:30 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e028b-f4e0-449a-a784-de229356aa60]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:30 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph Jul 11 03:59:30 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Acquiring lock "cinder-quobyte-a52be864-e831-4364-b756-e35982b9839e" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Lock "cinder-quobyte-a52be864-e831-4364-b756-e35982b9839e" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[25830411-bd89-4df8-b016-a459b5f5ddbe]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:30 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:30 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:31 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o9b8bgph" returned: 0 in 0.799s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:31 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 0 in 0.879s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:31 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:31 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:32 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 1 in 0.912s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 03:59:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:32 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e Jul 11 03:59:32 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.138s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Uploaded volume to glance image-id: 28f4e37a-6998-4e50-88d7-30857ed5f469. {{(pid=87437) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 11 03:59:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c31ae2ea-7525-4bbc-ac4a-2dde5943c9cc tempest-VolumesActionsTest-2087133683 None] Copy volume to image completed successfully. Jul 11 03:59:33 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a52be864-e831-4364-b756-e35982b9839e" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Lock "cinder-quobyte-a52be864-e831-4364-b756-e35982b9839e" released by "delete_volume" :: held 2.616s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Created reservations ['64047c3f-d726-4f39-b32c-b843a672104e', 'e471cb24-7a2f-48e0-9f3c-092374472e49', '2058fe11-74c3-4b68-ab28-9288310eb52f', '3fed8407-10ef-40c6-aa32-8ac5a2188a5d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:33 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:33 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "cinder-quobyte-264a1a01-7df3-4f14-81eb-6eb3afad95c6" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-quobyte-264a1a01-7df3-4f14-81eb-6eb3afad95c6" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfeacd2-2948-4700-b36a-b70471825fad]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:34 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:59:34 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:34 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.810s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:34 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Deleted volume successfully. Jul 11 03:59:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-df93e9d8-b3d4-4594-b1c4-5de3b581058c tempest-VolumesImageMetadata-224261644 None] Lock "cinder-a52be864-e831-4364-b756-e35982b9839e-delete_volume" released by "delete_volume" :: held 4.110s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:34 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.920s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:34 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6 Jul 11 03:59:34 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:35 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-264a1a01-7df3-4f14-81eb-6eb3afad95c6" returned: 0 in 0.761s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-quobyte-264a1a01-7df3-4f14-81eb-6eb3afad95c6" released by "delete_volume" :: held 1.738s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Created reservations ['d430e378-2897-4710-bc22-23d5f3247aa3', 'ffb5ddef-3e42-4de8-a689-48fc8d368694', '524eb2f7-a578-4d73-b573-9f221ec3ea1f', '543658f5-d4cd-4ca7-b9b5-bc5fcf0f8b31'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:35 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:35 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:36 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.761s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:36 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:36 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Deleted volume successfully. Jul 11 03:59:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f3b91691-3708-4726-b0bc-3b5f14bbaa55 tempest-VolumesActionsTest-2087133683 None] Lock "cinder-264a1a01-7df3-4f14-81eb-6eb3afad95c6-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Flow 'volume_create_manager' (6d944367-593b-47ac-af62-072d7be347f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7718e8-079a-4862-9dae-338d3ed2cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7718e8-079a-4862-9dae-338d3ed2cd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564129850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee63f49-89e0-4d74-9c7d-0513dd6fb81f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='014968a4e5ca4c1ea9acdb9d915a09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:37Z,use_quota=True,user_id='fa1bd97b0f9b4c198680802a71109ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6db58f-e8e6-42c1-90ff-2d32562d34d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6db58f-e8e6-42c1-90ff-2d32562d34d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1329658f-4231-421f-8aab-350b22be623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1329658f-4231-421f-8aab-350b22be623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee63f49-89e0-4d74-9c7d-0513dd6fb81f', 'volume_name': 'volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b9bdf5-7583-4b39-9ae5-e0a8c73fae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b9bdf5-7583-4b39-9ae5-e0a8c73fae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf57849a-7d63-4028-a825-4cc18fbb7707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Volume 7ee63f49-89e0-4d74-9c7d-0513dd6fb81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f', 'volume_size': 1} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564129850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee63f49-89e0-4d74-9c7d-0513dd6fb81f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='014968a4e5ca4c1ea9acdb9d915a09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:37Z,use_quota=True,user_id='fa1bd97b0f9b4c198680802a71109ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Creating volume 7ee63f49-89e0-4d74-9c7d-0513dd6fb81f {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:37 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:37 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f 1073741824 Jul 11 03:59:37 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Flow 'volume_create_manager' (8c53edef-244b-45ae-83fe-bd76c69c4021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c770355-9d2b-4072-a51d-3757f47ac796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c770355-9d2b-4072-a51d-3757f47ac796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1774814212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075642b8-da55-4264-975f-8953797c9837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad595fd1c5e1478a86fffe56d4323b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:37Z,use_quota=True,user_id='3cc8424b3cfc4632838d04c244ab51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbfcd91-3ba2-425c-8261-106584614cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbfcd91-3ba2-425c-8261-106584614cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32af84bc-4d96-41a5-9b3f-f29f2800e00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32af84bc-4d96-41a5-9b3f-f29f2800e00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075642b8-da55-4264-975f-8953797c9837', 'volume_name': 'volume-075642b8-da55-4264-975f-8953797c9837', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f87d5f8-f5b5-4cd8-bc41-1de2d174d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f87d5f8-f5b5-4cd8-bc41-1de2d174d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba9c0fe-d72c-4039-9b99-3b04d0d71375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:37 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Volume 075642b8-da55-4264-975f-8953797c9837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075642b8-da55-4264-975f-8953797c9837', 'volume_size': 1} Jul 11 03:59:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:38 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f 1073741824" returned: 0 in 0.894s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:38 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f Jul 11 03:59:38 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:39 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f" returned: 0 in 0.647s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1774814212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075642b8-da55-4264-975f-8953797c9837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad595fd1c5e1478a86fffe56d4323b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:37Z,use_quota=True,user_id='3cc8424b3cfc4632838d04c244ab51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Creating volume 075642b8-da55-4264-975f-8953797c9837 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:39 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf57849a-7d63-4028-a825-4cc18fbb7707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:39 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 1073741824 Jul 11 03:59:39 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21732874-4068-4b6a-9cdb-d33dfc00cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:39 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Volume volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f (7ee63f49-89e0-4d74-9c7d-0513dd6fb81f): created successfully Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21732874-4068-4b6a-9cdb-d33dfc00cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Flow 'volume_create_manager' (6d944367-593b-47ac-af62-072d7be347f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:39 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fd94332e-ce58-494a-9413-ff152aa3511f tempest-VolumesListTestJSON-700471924 None] Created volume successfully. Jul 11 03:59:40 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 1073741824" returned: 0 in 1.064s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Flow 'volume_create_manager' (39a94178-ac87-4b1b-976f-40da9ad2d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668061c8-c072-4e04-85a5-004af401ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668061c8-c072-4e04-85a5-004af401ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-850089998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f23db00-339e-4c8c-bcea-a11ab0ad7a5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='014968a4e5ca4c1ea9acdb9d915a09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:40Z,use_quota=True,user_id='fa1bd97b0f9b4c198680802a71109ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f4ec9-41a1-41d5-bd90-338864dc9fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f4ec9-41a1-41d5-bd90-338864dc9fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c63c306-d7c8-4f3b-87e0-ca31b4547e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c63c306-d7c8-4f3b-87e0-ca31b4547e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f23db00-339e-4c8c-bcea-a11ab0ad7a5c', 'volume_name': 'volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f59ee7-ecf6-4dfd-85e2-b1d4d55a9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f59ee7-ecf6-4dfd-85e2-b1d4d55a9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83386a0d-fa98-4e0e-8c7b-2b0159a5dbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:40 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Volume 4f23db00-339e-4c8c-bcea-a11ab0ad7a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c', 'volume_size': 1} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:40 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 Jul 11 03:59:40 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:41 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-850089998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f23db00-339e-4c8c-bcea-a11ab0ad7a5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='014968a4e5ca4c1ea9acdb9d915a09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:40Z,use_quota=True,user_id='fa1bd97b0f9b4c198680802a71109ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Creating volume 4f23db00-339e-4c8c-bcea-a11ab0ad7a5c {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:41 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:41 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c 1073741824 Jul 11 03:59:41 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba9c0fe-d72c-4039-9b99-3b04d0d71375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075642b8-da55-4264-975f-8953797c9837', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ff1200-1384-4813-803b-fba27b6a65d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:41 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Volume volume-075642b8-da55-4264-975f-8953797c9837 (075642b8-da55-4264-975f-8953797c9837): created successfully Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ff1200-1384-4813-803b-fba27b6a65d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Flow 'volume_create_manager' (8c53edef-244b-45ae-83fe-bd76c69c4021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4b1a963b-0087-47e3-bdd3-335f6a82adc1 tempest-VolumesListAdminTestJSON-1298625936 None] Created volume successfully. Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:42 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Flow 'volume_create_manager' (b24d52e1-e436-4e9f-9892-a97b31eb0df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50e8f07-766e-4e1b-b80d-13ee61f1bd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c 1073741824" returned: 0 in 1.052s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50e8f07-766e-4e1b-b80d-13ee61f1bd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1023760654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f269e5-5863-4ac0-98b5-b020d66c81eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad595fd1c5e1478a86fffe56d4323b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:42Z,use_quota=True,user_id='3cc8424b3cfc4632838d04c244ab51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e2d6f0-6b22-4599-8e50-3394217f133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e2d6f0-6b22-4599-8e50-3394217f133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a29a20-8d41-4f43-a6ab-98c0927b5150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a29a20-8d41-4f43-a6ab-98c0927b5150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f269e5-5863-4ac0-98b5-b020d66c81eb', 'volume_name': 'volume-07f269e5-5863-4ac0-98b5-b020d66c81eb', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a486bf1-a1da-4eea-9e91-cea23dc31487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a486bf1-a1da-4eea-9e91-cea23dc31487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9d9541-05fc-4241-b9e9-d74e3d97b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:42 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Volume 07f269e5-5863-4ac0-98b5-b020d66c81eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f269e5-5863-4ac0-98b5-b020d66c81eb', 'volume_size': 1} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:42 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c Jul 11 03:59:42 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:43 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1023760654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f269e5-5863-4ac0-98b5-b020d66c81eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad595fd1c5e1478a86fffe56d4323b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:42Z,use_quota=True,user_id='3cc8424b3cfc4632838d04c244ab51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Creating volume 07f269e5-5863-4ac0-98b5-b020d66c81eb {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:43 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83386a0d-fa98-4e0e-8c7b-2b0159a5dbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:43 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb 1073741824 Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32453cf-3e22-4950-bf58-8a06631bb823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:43 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Volume volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c (4f23db00-339e-4c8c-bcea-a11ab0ad7a5c): created successfully Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32453cf-3e22-4950-bf58-8a06631bb823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Flow 'volume_create_manager' (39a94178-ac87-4b1b-976f-40da9ad2d531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c9a65c25-ad84-455e-af4d-911f4a764191 tempest-VolumesListTestJSON-700471924 None] Created volume successfully. Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Flow 'volume_create_manager' (daa1bcb2-7112-4639-813e-974ae743f841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cc7be6-0bf6-4b8b-b2bd-b3963d44306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05cc7be6-0bf6-4b8b-b2bd-b3963d44306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1116692964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73f6266-4ee2-4ee3-9061-f01958463659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6819e80a229a4c82900e747314428467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:43Z,use_quota=True,user_id='583d5a19d187445580e136e884911303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489998f-6abf-404f-9bda-56aeb5b448b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d489998f-6abf-404f-9bda-56aeb5b448b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d6fcd-c86d-4311-b807-ce08b30ab245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d6fcd-c86d-4311-b807-ce08b30ab245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73f6266-4ee2-4ee3-9061-f01958463659', 'volume_name': 'volume-b73f6266-4ee2-4ee3-9061-f01958463659', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ef159b-24f6-4b97-9c9b-eb37646fd46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ef159b-24f6-4b97-9c9b-eb37646fd46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d95295-1429-41dc-812f-521f7b203413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Volume b73f6266-4ee2-4ee3-9061-f01958463659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73f6266-4ee2-4ee3-9061-f01958463659', 'volume_size': 1} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:43 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb 1073741824" returned: 0 in 0.855s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:43 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb Jul 11 03:59:43 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:44 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb" returned: 0 in 0.658s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1116692964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73f6266-4ee2-4ee3-9061-f01958463659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6819e80a229a4c82900e747314428467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:43Z,use_quota=True,user_id='583d5a19d187445580e136e884911303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Creating volume b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:44 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:44 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 1073741824 Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9d9541-05fc-4241-b9e9-d74e3d97b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f269e5-5863-4ac0-98b5-b020d66c81eb', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:44 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4d4c8f-0005-4069-bb39-4217e8023b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:44 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Volume volume-07f269e5-5863-4ac0-98b5-b020d66c81eb (07f269e5-5863-4ac0-98b5-b020d66c81eb): created successfully Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4d4c8f-0005-4069-bb39-4217e8023b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Flow 'volume_create_manager' (b24d52e1-e436-4e9f-9892-a97b31eb0df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5a748994-5f3e-42c8-8a43-7b0023255c93 tempest-VolumesListAdminTestJSON-1298625936 None] Created volume successfully. Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Flow 'volume_create_manager' (6a9d6a41-c48b-40fa-9689-73620fa69309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a214a1a2-ef2f-47bc-a13f-ec2e952e5cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a214a1a2-ef2f-47bc-a13f-ec2e952e5cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1492248587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e290ec-c456-4507-8836-8b46fe5c10d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='014968a4e5ca4c1ea9acdb9d915a09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:45Z,use_quota=True,user_id='fa1bd97b0f9b4c198680802a71109ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efca3cb7-1e40-411c-8d90-e8da89853708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efca3cb7-1e40-411c-8d90-e8da89853708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d569a4a6-e523-41fa-8ae7-9508f7c738dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d569a4a6-e523-41fa-8ae7-9508f7c738dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e290ec-c456-4507-8836-8b46fe5c10d4', 'volume_name': 'volume-87e290ec-c456-4507-8836-8b46fe5c10d4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76a9b19-ab91-437e-9b20-171a6f052cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76a9b19-ab91-437e-9b20-171a6f052cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1397cc0c-d1ec-4856-bde0-5e09216264fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:44 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Volume 87e290ec-c456-4507-8836-8b46fe5c10d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e290ec-c456-4507-8836-8b46fe5c10d4', 'volume_size': 1} Jul 11 03:59:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:45 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 1073741824" returned: 0 in 0.821s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:45 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 03:59:45 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Flow 'volume_create_manager' (2522a601-b6c7-4665-8952-d52a08f25a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c13ab3-4167-4c4e-b03f-78501d24f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c13ab3-4167-4c4e-b03f-78501d24f154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-132928850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d11d672-977c-4536-92c3-511783838275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad595fd1c5e1478a86fffe56d4323b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:46Z,use_quota=True,user_id='3cc8424b3cfc4632838d04c244ab51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143a84e0-bff9-4741-b130-fcf40d174fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143a84e0-bff9-4741-b130-fcf40d174fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c041aa-7a69-4c5b-adee-fdf8ca67b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c041aa-7a69-4c5b-adee-fdf8ca67b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d11d672-977c-4536-92c3-511783838275', 'volume_name': 'volume-0d11d672-977c-4536-92c3-511783838275', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2350629f-dcf6-4f9b-a2c4-2dc3562671c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2350629f-dcf6-4f9b-a2c4-2dc3562671c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be47e6d6-f976-496d-b895-94d9ce62dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Volume 0d11d672-977c-4536-92c3-511783838275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d11d672-977c-4536-92c3-511783838275', 'volume_size': 1} Jul 11 03:59:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:46 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 0.692s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1492248587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e290ec-c456-4507-8836-8b46fe5c10d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='014968a4e5ca4c1ea9acdb9d915a09fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:45Z,use_quota=True,user_id='fa1bd97b0f9b4c198680802a71109ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Creating volume 87e290ec-c456-4507-8836-8b46fe5c10d4 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:46 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:46 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 1073741824 Jul 11 03:59:46 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d95295-1429-41dc-812f-521f7b203413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73f6266-4ee2-4ee3-9061-f01958463659', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088a622d-228c-4155-9a21-9d59a54b8c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:46 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Volume volume-b73f6266-4ee2-4ee3-9061-f01958463659 (b73f6266-4ee2-4ee3-9061-f01958463659): created successfully Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088a622d-228c-4155-9a21-9d59a54b8c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Flow 'volume_create_manager' (daa1bcb2-7112-4639-813e-974ae743f841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7af2ebca-5e43-42d7-9eee-0a68003880da tempest-VolumesCloneTest-2129743279 None] Created volume successfully. Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Flow 'volume_create_manager' (0af1db42-5d11-44d7-9a6e-1c67103e50fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c72514c-00fc-40cf-ab3d-8c0bf2cb5f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c72514c-00fc-40cf-ab3d-8c0bf2cb5f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1260391350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a79a59c-c8b6-484f-8128-a13e731fbc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6819e80a229a4c82900e747314428467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b73f6266-4ee2-4ee3-9061-f01958463659,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:47Z,use_quota=True,user_id='583d5a19d187445580e136e884911303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56bc78c-bb17-488e-9014-edc745a35748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56bc78c-bb17-488e-9014-edc745a35748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad101353-2df3-4255-8d08-b3dc6bf164a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad101353-2df3-4255-8d08-b3dc6bf164a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a79a59c-c8b6-484f-8128-a13e731fbc9c', 'volume_name': 'volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c', 'volume_size': 2, 'source_volid': 'b73f6266-4ee2-4ee3-9061-f01958463659', 'source_volstatus': 'available'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ab6e44-65f1-4920-a816-5a5c7ea77b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ab6e44-65f1-4920-a816-5a5c7ea77b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd527c0-5ae9-410f-b98a-364f8ff44079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:47 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Volume 3a79a59c-c8b6-484f-8128-a13e731fbc9c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c', 'volume_size': 2, 'source_volid': 'b73f6266-4ee2-4ee3-9061-f01958463659', 'source_volstatus': 'available'} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:47 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 1073741824" returned: 0 in 0.872s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:47 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 Jul 11 03:59:47 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:47 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4" returned: 0 in 0.663s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-132928850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d11d672-977c-4536-92c3-511783838275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad595fd1c5e1478a86fffe56d4323b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:46Z,use_quota=True,user_id='3cc8424b3cfc4632838d04c244ab51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Creating volume 0d11d672-977c-4536-92c3-511783838275 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 03:59:47 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1397cc0c-d1ec-4856-bde0-5e09216264fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e290ec-c456-4507-8836-8b46fe5c10d4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:47 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 1073741824 Jul 11 03:59:47 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020813bc-f602-4820-883f-ba4ff2218093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:47 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Volume volume-87e290ec-c456-4507-8836-8b46fe5c10d4 (87e290ec-c456-4507-8836-8b46fe5c10d4): created successfully Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020813bc-f602-4820-883f-ba4ff2218093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Flow 'volume_create_manager' (6a9d6a41-c48b-40fa-9689-73620fa69309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e5811c84-c211-4e8d-b89d-2d717d2030a0 tempest-VolumesListTestJSON-700471924 None] Created volume successfully. Jul 11 03:59:48 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 1073741824" returned: 0 in 0.872s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:48 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 Jul 11 03:59:48 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:49 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275" returned: 0 in 0.680s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.345s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:49 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Cloning volume b73f6266-4ee2-4ee3-9061-f01958463659 to volume 3a79a59c-c8b6-484f-8128-a13e731fbc9c Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be47e6d6-f976-496d-b895-94d9ce62dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d11d672-977c-4536-92c3-511783838275', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db77acdb-c22c-4bf2-bc34-083881b637d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:49 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Volume volume-0d11d672-977c-4536-92c3-511783838275 (0d11d672-977c-4536-92c3-511783838275): created successfully Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db77acdb-c22c-4bf2-bc34-083881b637d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Flow 'volume_create_manager' (2522a601-b6c7-4665-8952-d52a08f25a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Creating offline snapshot 63964b51-0bd9-4ec5-96f3-6c42bb031d41 of volume b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 03:59:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3c903329-c5c2-4163-8c4e-8bec5bea0316 tempest-VolumesListAdminTestJSON-1298625936 None] Created volume successfully. Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa030e80-fb91-4d32-a4a0-870ea754518b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:49 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 03:59:49 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:50 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:50 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 1G Jul 11 03:59:50 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "cinder-87e290ec-c456-4507-8836-8b46fe5c10d4-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-87e290ec-c456-4507-8836-8b46fe5c10d4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "cinder-quobyte-87e290ec-c456-4507-8836-8b46fe5c10d4" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-quobyte-87e290ec-c456-4507-8836-8b46fe5c10d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8d9cf-1acf-4fa9-b899-4ec976a7ca77]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Flow 'volume_create_manager' (c8fc60a1-2b75-43b9-99e1-b6d1c3512f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e87417-be76-4bcc-94e4-660be3d423a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:50 devstack sudo[94698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 Jul 11 03:59:50 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e87417-be76-4bcc-94e4-660be3d423a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4917f44f-7da7-4c2a-9408-d5ef32aff1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e16de70177c4b7f81b6a7f457312fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:51Z,use_quota=True,user_id='d180534e97c6477ca95856bd5f132948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6058ffa-491e-4c2f-ab88-0c9bb75e0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6058ffa-491e-4c2f-ab88-0c9bb75e0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695d9a90-af28-453a-8784-d1c87af43180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695d9a90-af28-453a-8784-d1c87af43180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4917f44f-7da7-4c2a-9408-d5ef32aff1c3', 'volume_name': 'volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0158eccf-e1ec-4049-81c3-327a465f9c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0158eccf-e1ec-4049-81c3-327a465f9c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdaf3c9-ab90-4259-acab-439b3bf708f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 03:59:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Volume 4917f44f-7da7-4c2a-9408-d5ef32aff1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3', 'volume_size': 1} Jul 11 03:59:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:51 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 1G" returned: 0 in 0.942s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73f6266-4ee2-4ee3-9061-f01958463659 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:51 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73f6266-4ee2-4ee3-9061-f01958463659 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 Jul 11 03:59:51 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:51 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4" returned: 0 in 0.811s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:51 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4 Jul 11 03:59:51 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:51 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b73f6266-4ee2-4ee3-9061-f01958463659 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:51 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 is being set with open permissions: ugo+rw Jul 11 03:59:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:51 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 Jul 11 03:59:51 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:52 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-87e290ec-c456-4507-8836-8b46fe5c10d4" returned: 0 in 0.640s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-quobyte-87e290ec-c456-4507-8836-8b46fe5c10d4" released by "delete_volume" :: held 1.497s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Created reservations ['b83d6723-a61c-4427-8b42-b876af500a2c', 'b4006314-9607-41c8-9efc-06b8d4b9bc33', '3c54da20-fee0-42c9-a88c-df720ab8abd3', 'a14ce85a-0986-44b7-80ec-368fe11898a8'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:52 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:52 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:52 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41" returned: 0 in 0.680s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:52 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info Jul 11 03:59:52 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "cinder-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "cinder-quobyte-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-quobyte-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[378a70b4-a77e-484d-995f-70185c7e15c9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:53 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Deleted volume successfully. Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6c19c04d-e573-4e04-b1a1-d10280fbdc21 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-87e290ec-c456-4507-8836-8b46fe5c10d4-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:53 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c Jul 11 03:59:53 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:53 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:53 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info is being set with open permissions: ugo+rw Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:53 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info Jul 11 03:59:53 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:53 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c" returned: 0 in 0.840s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:53 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c Jul 11 03:59:53 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:54 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.info" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Acquiring lock "cinder-quobyte-3a79a59c-c8b6-484f-8128-a13e731fbc9c" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-3a79a59c-c8b6-484f-8128-a13e731fbc9c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] snapshot: 63964b51-0bd9-4ec5-96f3-6c42bb031d41, volume: 3a79a59c-c8b6-484f-8128-a13e731fbc9c, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06d1723-3d99-4012-8230-c10be88e2ba8]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:54 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 Jul 11 03:59:54 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:54 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c" returned: 0 in 0.712s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-quobyte-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c" released by "delete_volume" :: held 1.591s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Created reservations ['073d4d7f-b1af-4596-ad7c-eca4a09263c4', 'df159e36-09c6-40df-8eb9-520804e7f1e2', 'fdf391f6-b448-425c-9f20-9a7180ebd518', 'd3e08184-6558-4c46-a614-ca46518d43bc'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:54 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:54 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:54 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41" returned: 0 in 0.797s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73f6266-4ee2-4ee3-9061-f01958463659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9dc514-2232-4390-abf7-678f0cd8b12d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:55 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 03:59:55 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "cinder-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "cinder-quobyte-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-quobyte-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec0c67e-3122-4abd-8a20-89194483df38]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:55 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.742s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Deleted volume successfully. Jul 11 03:59:55 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f Jul 11 03:59:55 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b777b00e-d871-4f38-acee-b114c40769f6 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-4f23db00-339e-4c8c-bcea-a11ab0ad7a5c-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:55 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 0.847s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 03:59:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:55 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c Jul 11 03:59:55 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:56 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f" returned: 0 in 0.801s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:56 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f Jul 11 03:59:56 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:57 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f" returned: 0 in 0.918s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-quobyte-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f" released by "delete_volume" :: held 1.811s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Created reservations ['799869c0-943c-406f-9e28-01263b28d60b', 'fb80555e-e9c4-4492-8b74-9af102b60cff', '91494738-2345-4c72-bbd6-031bf7ad0827', '37bdad05-de9e-43be-a9ca-86d226005311'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 03:59:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 03:59:57 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 03:59:57 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 03:59:59 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Jul 11 03:59:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.691s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 03:59:59 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 03:59:59 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Deleted volume successfully. Jul 11 03:59:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4c1c343e-3098-4d11-9e43-cd59cdb17c26 tempest-VolumesListTestJSON-700471924 None] Lock "cinder-7ee63f49-89e0-4d74-9c7d-0513dd6fb81f-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:01 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c" returned: 0 in 5.735s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e84a0-f4f4-409f-b83e-ec03de849608]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:01 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 04:00:01 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:02 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 0.970s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:02 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:00:02 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Converted 1024.00 MB image at 178.53 MB/s Jul 11 04:00:02 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c is being set with open permissions: ugo+rw Jul 11 04:00:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:02 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c Jul 11 04:00:02 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:03 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-3a79a59c-c8b6-484f-8128-a13e731fbc9c" released by "_copy_volume_from_snapshot" :: held 9.089s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Acquiring lock "cinder-quobyte-63964b51-0bd9-4ec5-96f3-6c42bb031d41" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-63964b51-0bd9-4ec5-96f3-6c42bb031d41" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Deleting offline snapshot 63964b51-0bd9-4ec5-96f3-6c42bb031d41 of volume b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] snapshot_file for this snap is: volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a20ee1-955b-425b-99ca-bfdcd374bbfa]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:03 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 Jul 11 04:00:03 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:04 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41" returned: 0 in 0.831s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b73f6266-4ee2-4ee3-9061-f01958463659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:00:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e914a94-116f-447d-9016-a6ae0fbdf997]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:04 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 04:00:04 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:04 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 0.773s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:04 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 Jul 11 04:00:04 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:05 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41" returned: 0 in 0.799s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:05 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41 Jul 11 04:00:05 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:06 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659.63964b51-0bd9-4ec5-96f3-6c42bb031d41" returned: 0 in 0.645s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-63964b51-0bd9-4ec5-96f3-6c42bb031d41" released by "_delete_snapshot" :: held 3.148s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.051s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.437s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T01:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4917f44f-7da7-4c2a-9408-d5ef32aff1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e16de70177c4b7f81b6a7f457312fed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T01:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T01:59:51Z,use_quota=True,user_id='d180534e97c6477ca95856bd5f132948',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Creating volume 4917f44f-7da7-4c2a-9408-d5ef32aff1c3 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:06 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:06 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 1073741824 Jul 11 04:00:06 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd527c0-5ae9-410f-b98a-364f8ff44079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c', 'volume_size': 2, 'source_volid': 'b73f6266-4ee2-4ee3-9061-f01958463659', 'source_volstatus': 'available'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3f5caf-ee18-45bf-92c8-352a19e674dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:06 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Volume volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c (3a79a59c-c8b6-484f-8128-a13e731fbc9c): created successfully Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3f5caf-ee18-45bf-92c8-352a19e674dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Flow 'volume_create_manager' (0af1db42-5d11-44d7-9a6e-1c67103e50fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1f16ab6d-8240-4555-8f74-0d4f52db7aea tempest-VolumesCloneTest-2129743279 None] Created volume successfully. Jul 11 04:00:07 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 1073741824" returned: 0 in 0.959s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:07 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 Jul 11 04:00:07 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Acquiring lock "cinder-3a79a59c-c8b6-484f-8128-a13e731fbc9c-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-3a79a59c-c8b6-484f-8128-a13e731fbc9c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Acquiring lock "cinder-quobyte-3a79a59c-c8b6-484f-8128-a13e731fbc9c" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-3a79a59c-c8b6-484f-8128-a13e731fbc9c" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c598c8-6cc7-499b-88dc-83f25addc9d3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:08 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c Jul 11 04:00:08 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:08 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3" returned: 0 in 0.830s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdaf3c9-ab90-4259-acab-439b3bf708f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9f1c7f-0faa-4a6f-9dae-1e42b5cd80d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:08 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Volume volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 (4917f44f-7da7-4c2a-9408-d5ef32aff1c3): created successfully Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9f1c7f-0faa-4a6f-9dae-1e42b5cd80d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Flow 'volume_create_manager' (c8fc60a1-2b75-43b9-99e1-b6d1c3512f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:08 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-398813d9-5b44-4526-9053-592c36ecec7f tempest-VolumesListAdminTestJSON-713413206 None] Created volume successfully. Jul 11 04:00:08 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c" returned: 0 in 0.892s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:08 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c Jul 11 04:00:08 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Acquiring lock "cinder-4917f44f-7da7-4c2a-9408-d5ef32aff1c3-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Lock "cinder-4917f44f-7da7-4c2a-9408-d5ef32aff1c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:09 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3a79a59c-c8b6-484f-8128-a13e731fbc9c" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-3a79a59c-c8b6-484f-8128-a13e731fbc9c" released by "delete_volume" :: held 1.666s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Acquiring lock "cinder-quobyte-4917f44f-7da7-4c2a-9408-d5ef32aff1c3" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Lock "cinder-quobyte-4917f44f-7da7-4c2a-9408-d5ef32aff1c3" acquired by "delete_volume" :: waited 0.036s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "cinder-0d11d672-977c-4536-92c3-511783838275-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4236c-2ed9-4f07-9e28-32283fd5fe4d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-0d11d672-977c-4536-92c3-511783838275-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Created reservations ['71c91593-ed87-4449-b7d8-dfea0ff6eafc', 'e6a85d6f-9785-4066-ad25-7364bddab84d', '50561105-89ca-407d-9732-19ebc3dbf810', '5e834631-455a-4741-95f9-76268a30a591'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "cinder-quobyte-0d11d672-977c-4536-92c3-511783838275" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-quobyte-0d11d672-977c-4536-92c3-511783838275" acquired by "delete_volume" :: waited 0.040s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:09 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 Jul 11 04:00:09 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af6769-169a-4ff1-8c9e-1c285d9ad831]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:09 devstack sudo[94831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:09 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:09 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 Jul 11 04:00:09 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Acquiring lock "cinder-b73f6266-4ee2-4ee3-9061-f01958463659-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-b73f6266-4ee2-4ee3-9061-f01958463659-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Acquiring lock "cinder-quobyte-b73f6266-4ee2-4ee3-9061-f01958463659" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-b73f6266-4ee2-4ee3-9061-f01958463659" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cefbf82-4b37-4d26-b128-1db3bd34a793]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:10 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 04:00:10 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:10 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3" returned: 0 in 1.127s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:10 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3 Jul 11 04:00:10 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:10 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:10 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275" returned: 0 in 1.051s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.014s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:10 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Deleted volume successfully. Jul 11 04:00:10 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275 Jul 11 04:00:10 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2823cff1-f408-42ad-a21d-5582054ed3f1 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-3a79a59c-c8b6-484f-8128-a13e731fbc9c-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:11 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 1.139s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:11 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659 Jul 11 04:00:11 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:11 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4917f44f-7da7-4c2a-9408-d5ef32aff1c3" returned: 0 in 0.927s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:11 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0d11d672-977c-4536-92c3-511783838275" returned: 0 in 0.845s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Lock "cinder-quobyte-4917f44f-7da7-4c2a-9408-d5ef32aff1c3" released by "delete_volume" :: held 2.130s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-quobyte-0d11d672-977c-4536-92c3-511783838275" released by "delete_volume" :: held 1.975s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Created reservations ['f6852d52-844b-494b-8253-0c1039e5dd09', '0770c6d7-92f3-4e09-a499-c850add45228', '42c774cf-17a4-4dbb-a9fe-21f0f015fb77', '4e29264d-8d64-4f06-9976-286db312d03b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Created reservations ['0b4226d5-8144-442e-bf66-ecb9ba9563f3', 'b0cf862a-720b-48b3-bbc2-02d4debddebe', '70ada789-2fda-43d1-a8dc-4b7fa7ea2ba0', 'f4ad9610-cffb-431b-829d-723302628be7'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:11 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:11 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:12 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:12 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "cinder-07f269e5-5863-4ac0-98b5-b020d66c81eb-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-07f269e5-5863-4ac0-98b5-b020d66c81eb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "cinder-quobyte-07f269e5-5863-4ac0-98b5-b020d66c81eb" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-quobyte-07f269e5-5863-4ac0-98b5-b020d66c81eb" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13ac44-62e1-4897-aaa0-c0d87ade6889]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:12 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b73f6266-4ee2-4ee3-9061-f01958463659" returned: 0 in 0.951s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-quobyte-b73f6266-4ee2-4ee3-9061-f01958463659" released by "delete_volume" :: held 2.205s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:12 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb Jul 11 04:00:12 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Created reservations ['dd0823aa-cdde-4045-84e2-5c8f0a82d113', '3e6954bc-3358-40c4-8c53-4c8c886a6943', '88f60cd8-fbb2-41fe-ab46-c760bd366633', '56cf026f-77f8-48ba-bfff-1ddf66b0f01a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:12 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.848s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Deleted volume successfully. Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:12 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:12 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ec69ec4c-0b54-4140-bdc1-d707bf7d12fe tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-0d11d672-977c-4536-92c3-511783838275-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:12 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.962s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Deleted volume successfully. Jul 11 04:00:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fac322ad-03b2-421c-95d7-ee2550ec5805 tempest-VolumesListAdminTestJSON-713413206 None] Lock "cinder-4917f44f-7da7-4c2a-9408-d5ef32aff1c3-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:13 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb" returned: 0 in 1.143s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:13 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb Jul 11 04:00:13 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:13 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.873s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:13 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Deleted volume successfully. Jul 11 04:00:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481f0920-fc86-42ea-8f1f-fcf7ca880856 tempest-VolumesCloneTest-2129743279 None] Lock "cinder-b73f6266-4ee2-4ee3-9061-f01958463659-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:14 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:14 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:14 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-07f269e5-5863-4ac0-98b5-b020d66c81eb" returned: 0 in 0.823s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-quobyte-07f269e5-5863-4ac0-98b5-b020d66c81eb" released by "delete_volume" :: held 2.027s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Created reservations ['a2521856-e70a-4665-ba29-f025c4d1b71a', '6d844dc3-624a-41bc-bb5e-fb841eace6e9', '986acbe8-9670-408b-aede-c0d060581bc2', '5eb17f98-a1f4-43d0-b111-6f510ea09a8b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:14 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:14 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:14 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.873s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:00:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:00:15 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Deleted volume successfully. Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ce5cdb9e-0cff-4602-8c45-93d1321df3d4 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-07f269e5-5863-4ac0-98b5-b020d66c81eb-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "cinder-075642b8-da55-4264-975f-8953797c9837-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-075642b8-da55-4264-975f-8953797c9837-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "cinder-quobyte-075642b8-da55-4264-975f-8953797c9837" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-quobyte-075642b8-da55-4264-975f-8953797c9837" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[769b505f-0d8f-482c-9a10-2ca7eb2646c8]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:15 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 Jul 11 04:00:15 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:16 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837" returned: 0 in 0.945s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:16 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837 Jul 11 04:00:16 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:17 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-075642b8-da55-4264-975f-8953797c9837" returned: 0 in 0.812s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-quobyte-075642b8-da55-4264-975f-8953797c9837" released by "delete_volume" :: held 1.814s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Created reservations ['e651ff77-203b-4c41-89fe-8a1c025956ea', '29f703ae-5275-4f9a-8aa0-d3fc90cae77d', '845b1bd9-73ef-4dc4-8731-1af5478d9b3d', '5488875b-9bb1-4119-bd1d-668418aeb455'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:17 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:17 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:18 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.018s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:18 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Deleted volume successfully. Jul 11 04:00:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-822780c0-16cb-48a2-8433-85e2caf52e99 tempest-VolumesListAdminTestJSON-1298625936 None] Lock "cinder-075642b8-da55-4264-975f-8953797c9837-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:27 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=79,cinder:INSERT=34,cinder:UPDATE=110,cinder:DELETE=12 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=130,cinder:SELECT=88,cinder:INSERT=33,cinder:DELETE=9 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Flow 'volume_create_manager' (4cc223d1-1cf0-44ca-9b4e-994438e0074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d827e6-407f-440c-bec1-3eae819fb1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d827e6-407f-440c-bec1-3eae819fb1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-375597827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d114d180-4250-42f2-ae4d-b313e3290939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492da05d60f44e9b099435bc8fe65f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:28Z,use_quota=True,user_id='22a75a7df05046fd884aadc4359f4011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f440078c-4a9e-4f5a-9641-7dd38f2d9fb0),volume_type_id=f440078c-4a9e-4f5a-9641-7dd38f2d9fb0)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506b1409-4948-467f-b215-883fabfebf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506b1409-4948-467f-b215-883fabfebf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2b9eb4-73e4-4467-b6ad-4aaf3f4e991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2b9eb4-73e4-4467-b6ad-4aaf3f4e991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd114d180-4250-42f2-ae4d-b313e3290939', 'volume_name': 'volume-d114d180-4250-42f2-ae4d-b313e3290939', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86baee71-6f93-4454-834d-a79af97b2982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86baee71-6f93-4454-834d-a79af97b2982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a122daf-ff16-4136-8a55-3fdec4b20d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:28 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume d114d180-4250-42f2-ae4d-b313e3290939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d114d180-4250-42f2-ae4d-b313e3290939', 'volume_size': 1} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-375597827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d114d180-4250-42f2-ae4d-b313e3290939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492da05d60f44e9b099435bc8fe65f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:28Z,use_quota=True,user_id='22a75a7df05046fd884aadc4359f4011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f440078c-4a9e-4f5a-9641-7dd38f2d9fb0),volume_type_id=f440078c-4a9e-4f5a-9641-7dd38f2d9fb0)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Creating volume d114d180-4250-42f2-ae4d-b313e3290939 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:28 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:28 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 1073741824 Jul 11 04:00:28 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Flow 'volume_create_manager' (32bbc191-bc47-4ae2-a058-00c8aeb509ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c538b9c4-196b-4de8-ae01-3392777c1691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c538b9c4-196b-4de8-ae01-3392777c1691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1442487604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974e392a-f839-4dab-b99c-d64acbd9bfc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492da05d60f44e9b099435bc8fe65f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:29Z,use_quota=True,user_id='22a75a7df05046fd884aadc4359f4011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65cd3b2e-ae34-4251-8295-0137788fcf87),volume_type_id=65cd3b2e-ae34-4251-8295-0137788fcf87)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a9ba13-b4b3-4c8a-b0af-45a10090f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a9ba13-b4b3-4c8a-b0af-45a10090f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4eb38d-be96-47d1-bfd3-63947d5a272b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4eb38d-be96-47d1-bfd3-63947d5a272b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974e392a-f839-4dab-b99c-d64acbd9bfc4', 'volume_name': 'volume-974e392a-f839-4dab-b99c-d64acbd9bfc4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c12703-b6e3-46d6-8d4e-2c170b8df43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c12703-b6e3-46d6-8d4e-2c170b8df43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab727a0-5220-48a4-85db-b098c8297d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:29 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume 974e392a-f839-4dab-b99c-d64acbd9bfc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974e392a-f839-4dab-b99c-d64acbd9bfc4', 'volume_size': 1} Jul 11 04:00:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:30 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 1073741824" returned: 0 in 1.484s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:30 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 Jul 11 04:00:30 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Flow 'volume_create_manager' (2ba3e299-8778-478b-9388-c1160ebdd367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a79a9a0-e458-4f53-ad6f-09d2de25412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a79a9a0-e458-4f53-ad6f-09d2de25412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1980728990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a705d88-cd0c-4795-9637-fecdac425924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492da05d60f44e9b099435bc8fe65f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:30Z,use_quota=True,user_id='22a75a7df05046fd884aadc4359f4011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74a276ab-851c-48b6-8cfd-d77c11e95a44),volume_type_id=74a276ab-851c-48b6-8cfd-d77c11e95a44)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679bb052-c2fb-48c7-a758-d331b4c12cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679bb052-c2fb-48c7-a758-d331b4c12cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63ade62-877a-4fbb-98cd-0f74549becbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63ade62-877a-4fbb-98cd-0f74549becbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a705d88-cd0c-4795-9637-fecdac425924', 'volume_name': 'volume-4a705d88-cd0c-4795-9637-fecdac425924', 'volume_size': 1, 'image_id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--936565358', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6492da05d60f44e9b099435bc8fe65f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'created_at': datetime.datetime(2026, 7, 11, 2, 0, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 0, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99/file', 'properties': {}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3020d449-0267-4164-9df8-a10bfa073c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3020d449-0267-4164-9df8-a10bfa073c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b922401a-895e-4d00-b0dc-b2ba6cde39f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:30 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume 4a705d88-cd0c-4795-9637-fecdac425924: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a705d88-cd0c-4795-9637-fecdac425924', 'volume_size': 1, 'image_id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--936565358', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6492da05d60f44e9b099435bc8fe65f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'created_at': datetime.datetime(2026, 7, 11, 2, 0, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 0, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99/file', 'properties': {}}, 'image_service': } Jul 11 04:00:30 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Trying to clone 4a705d88-cd0c-4795-9637-fecdac425924 from image ece7bdc5-f6f3-4930-84d3-e52a8c010a99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:00:31 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:00:31 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939" returned: 0 in 1.551s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] <== create_volume: return (3124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.127s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1442487604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974e392a-f839-4dab-b99c-d64acbd9bfc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492da05d60f44e9b099435bc8fe65f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:29Z,use_quota=True,user_id='22a75a7df05046fd884aadc4359f4011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65cd3b2e-ae34-4251-8295-0137788fcf87),volume_type_id=65cd3b2e-ae34-4251-8295-0137788fcf87)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Creating volume 974e392a-f839-4dab-b99c-d64acbd9bfc4 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:31 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:31 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 1073741824 Jul 11 04:00:31 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a122daf-ff16-4136-8a55-3fdec4b20d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d114d180-4250-42f2-ae4d-b313e3290939', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c56d5e-30ac-42b0-acb8-ec025f0c518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Flow 'volume_create_manager' (2d6fc035-3e62-4646-9613-c29f4451ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af33e41-ad24-4730-bf4b-6654f95e408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f9e59-35d9-49f0-bc00-14b475c4d148]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume volume-d114d180-4250-42f2-ae4d-b313e3290939 (d114d180-4250-42f2-ae4d-b313e3290939): created successfully Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c56d5e-30ac-42b0-acb8-ec025f0c518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Flow 'volume_create_manager' (4cc223d1-1cf0-44ca-9b4e-994438e0074f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af33e41-ad24-4730-bf4b-6654f95e408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-116701692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95e15a9-4e7e-4301-9608-b10651604840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e44fea03764d2a9bf55a8bc28d1f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:31Z,use_quota=True,user_id='969678ca42b94ee59283b55f485d6519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d94d191-90ae-4ea0-bce6-14b05f8d2955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d94d191-90ae-4ea0-bce6-14b05f8d2955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4586bad3-4efd-4d0d-9399-e8698f099262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4586bad3-4efd-4d0d-9399-e8698f099262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95e15a9-4e7e-4301-9608-b10651604840', 'volume_name': 'volume-f95e15a9-4e7e-4301-9608-b10651604840', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913ac31b-0ca6-43b3-8a4d-001ce31b9769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913ac31b-0ca6-43b3-8a4d-001ce31b9769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb2e968-1c11-4269-9f3e-eb1ec11f7d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Volume f95e15a9-4e7e-4301-9608-b10651604840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95e15a9-4e7e-4301-9608-b10651604840', 'volume_size': 1} Jul 11 04:00:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8865b614-66ca-42f2-946b-09aca042576d tempest-TestInstancesWithCinderVolumes-1875975658 None] Created volume successfully. Jul 11 04:00:32 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD Jul 11 04:00:32 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:32 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (c7f051f9-4ac5-4bb1-9a6d-83361cedac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:32 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2b7c61-0199-4cb0-9c33-6c47a37784f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD" returned: 0 in 0.915s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 1073741824" returned: 0 in 1.063s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Temporary image ece7bdc5-f6f3-4930-84d3-e52a8c010a99 is fetched for user 22a75a7df05046fd884aadc4359f4011. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2b7c61-0199-4cb0-9c33-6c47a37784f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-581753993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aef291-25a6-4c7a-b953-70807a824604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:33Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ac8e8e-3c6d-4fa8-a44e-6f57e85df356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ac8e8e-3c6d-4fa8-a44e-6f57e85df356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c9b52-5cbe-4df9-8c92-512a841f9040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2c9b52-5cbe-4df9-8c92-512a841f9040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84aef291-25a6-4c7a-b953-70807a824604', 'volume_name': 'volume-84aef291-25a6-4c7a-b953-70807a824604', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d14063-ba51-4f12-aa77-52d03c17cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d14063-ba51-4f12-aa77-52d03c17cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab97191d-ab30-4457-b8ca-0cc950df623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:32 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Volume 84aef291-25a6-4c7a-b953-70807a824604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84aef291-25a6-4c7a-b953-70807a824604', 'volume_size': 1} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[79447bad-6a15-43ae-b89e-85fa1dc3e873]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:32 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 Jul 11 04:00:32 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:32 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD Jul 11 04:00:32 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:33 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4" returned: 0 in 0.642s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-116701692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95e15a9-4e7e-4301-9608-b10651604840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8e44fea03764d2a9bf55a8bc28d1f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:31Z,use_quota=True,user_id='969678ca42b94ee59283b55f485d6519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Creating volume f95e15a9-4e7e-4301-9608-b10651604840 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:33 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:33 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 1073741824 Jul 11 04:00:33 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab727a0-5220-48a4-85db-b098c8297d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974e392a-f839-4dab-b99c-d64acbd9bfc4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6012d1a-0361-4061-ae4d-5f0f08211abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:33 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 (974e392a-f839-4dab-b99c-d64acbd9bfc4): created successfully Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6012d1a-0361-4061-ae4d-5f0f08211abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Flow 'volume_create_manager' (32bbc191-bc47-4ae2-a058-00c8aeb509ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:33 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-21db5267-3fa9-487f-95f8-7953cb740d94 tempest-TestInstancesWithCinderVolumes-1875975658 None] Created volume successfully. Jul 11 04:00:34 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 1073741824" returned: 0 in 0.797s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:34 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 Jul 11 04:00:34 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:34 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840" returned: 0 in 0.617s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.158s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-581753993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aef291-25a6-4c7a-b953-70807a824604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:33Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Creating volume 84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:34 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:35 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 1073741824 Jul 11 04:00:35 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edb2e968-1c11-4269-9f3e-eb1ec11f7d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95e15a9-4e7e-4301-9608-b10651604840', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afba194c-7ff0-4c5c-918f-efc3fdd3875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Volume volume-f95e15a9-4e7e-4301-9608-b10651604840 (f95e15a9-4e7e-4301-9608-b10651604840): created successfully Jul 11 04:00:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afba194c-7ff0-4c5c-918f-efc3fdd3875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Flow 'volume_create_manager' (2d6fc035-3e62-4646-9613-c29f4451ae40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-74c652fa-549b-4b29-bd7c-f3a957f1b5d6 tempest-VolumesMetadataTest-1144131441 None] Created volume successfully. Jul 11 04:00:35 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 1073741824" returned: 0 in 0.809s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:35 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 Jul 11 04:00:35 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Acquiring lock "cinder-f95e15a9-4e7e-4301-9608-b10651604840-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Lock "cinder-f95e15a9-4e7e-4301-9608-b10651604840-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Acquiring lock "cinder-quobyte-f95e15a9-4e7e-4301-9608-b10651604840" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Lock "cinder-quobyte-f95e15a9-4e7e-4301-9608-b10651604840" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f12f25-3337-4c3a-b892-2b3460f2ddb7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:36 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604" returned: 0 in 0.652s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.886s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1980728990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a705d88-cd0c-4795-9637-fecdac425924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6492da05d60f44e9b099435bc8fe65f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:30Z,use_quota=True,user_id='22a75a7df05046fd884aadc4359f4011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74a276ab-851c-48b6-8cfd-d77c11e95a44),volume_type_id=74a276ab-851c-48b6-8cfd-d77c11e95a44)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Creating volume 4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:36 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:36 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 1073741824 Jul 11 04:00:36 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab97191d-ab30-4457-b8ca-0cc950df623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84aef291-25a6-4c7a-b953-70807a824604', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381be895-6c96-4e4a-8199-b79e0bc9d410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:36 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Volume volume-84aef291-25a6-4c7a-b953-70807a824604 (84aef291-25a6-4c7a-b953-70807a824604): created successfully Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381be895-6c96-4e4a-8199-b79e0bc9d410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (c7f051f9-4ac5-4bb1-9a6d-83361cedac8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:36 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-97e8b1e5-ee07-4605-8bf0-add8ea0d6ea8 tempest-VolumesSnapshotTestJSON-383750334 None] Created volume successfully. Jul 11 04:00:36 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 Jul 11 04:00:36 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:37 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840" returned: 0 in 0.859s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:37 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840 Jul 11 04:00:37 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:37 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 1073741824" returned: 0 in 0.893s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:37 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:00:37 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:37 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f95e15a9-4e7e-4301-9608-b10651604840" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Lock "cinder-quobyte-f95e15a9-4e7e-4301-9608-b10651604840" released by "delete_volume" :: held 1.574s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Created reservations ['fb0f30b5-1f7d-4a65-b2fa-4573f2961d1b', 'c76cd75c-8ce7-4573-b5dd-4659d2772118', '3d932a3c-37bd-44c0-82be-5ab359652162', 'b56e7109-d849-4674-b09e-8c459acc12af'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:38 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 0 in 0.659s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.881s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Attempting download of ece7bdc5-f6f3-4930-84d3-e52a8c010a99 ((None, [{'url': 'file:///opt/stack/data/glance/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'metadata': {}}])) to volume 4a705d88-cd0c-4795-9637-fecdac425924. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:00:38 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:38 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Creating offline snapshot 85972378-d879-4fad-bbaf-a64db487627d of volume 84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5df106-bd3c-458f-8f07-808ea347797f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8e3b66-f342-4c61-85a3-f7a6a1d5e0a7]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:38 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 Jul 11 04:00:38 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:38 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8 Jul 11 04:00:38 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:38 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.696s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Deleted volume successfully. Jul 11 04:00:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-99331ac8-4f53-426f-8e36-b30a49501a9f tempest-VolumesMetadataTest-1144131441 None] Lock "cinder-f95e15a9-4e7e-4301-9608-b10651604840-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:39 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8" returned: 0 in 0.807s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:39 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604" returned: 0 in 0.865s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:39 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d 1G Jul 11 04:00:39 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:39 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8 Jul 11 04:00:39 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:39 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8" returned: 1 in 0.835s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_asgds7d8' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec537ad-4b43-4c8e-9654-33006c9f875c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:40 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD Jul 11 04:00:40 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:40 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d 1G" returned: 0 in 0.948s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aef291-25a6-4c7a-b953-70807a824604 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:40 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aef291-25a6-4c7a-b953-70807a824604 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d Jul 11 04:00:40 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:40 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD" returned: 0 in 0.857s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] ece7bdc5-f6f3-4930-84d3-e52a8c010a99 was qcow2, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:40 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84aef291-25a6-4c7a-b953-70807a824604 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:40 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d is being set with open permissions: ugo+rw Jul 11 04:00:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:40 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:00:40 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:40 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d Jul 11 04:00:40 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:41 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:41 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info Jul 11 04:00:41 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:42 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info" returned: 0 in 0.731s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:42 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info is being set with open permissions: ugo+rw Jul 11 04:00:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:42 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info Jul 11 04:00:42 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:43 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.info" returned: 0 in 0.850s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.083s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:43 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 0 in 2.407s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ece7bdc5-f6f3-4930-84d3-e52a8c010a99_oykf0du_devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:00:43 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Converted 112.00 MB image at 46.51 MB/s Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:43 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 1G Jul 11 04:00:43 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-be506c6b-0d14-4dc8-ba31-d465b2751671 tempest-VolumesSnapshotTestJSON-383750334 None] Create snapshot completed successfully Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-85972378-d879-4fad-bbaf-a64db487627d-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-85972378-d879-4fad-bbaf-a64db487627d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-84aef291-25a6-4c7a-b953-70807a824604" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-84aef291-25a6-4c7a-b953-70807a824604" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-85972378-d879-4fad-bbaf-a64db487627d" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-85972378-d879-4fad-bbaf-a64db487627d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Deleting offline snapshot 85972378-d879-4fad-bbaf-a64db487627d of volume 84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] snapshot_file for this snap is: volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f97aa3-a416-4f00-a80c-557eef282ca0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:43 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d Jul 11 04:00:43 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:44 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 1G" returned: 0 in 0.787s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131ac93-a5df-43e4-926f-feb2736df799]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:44 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:00:44 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:44 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d" returned: 0 in 0.875s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84aef291-25a6-4c7a-b953-70807a824604(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[92681e36-4eec-432a-8e72-7794e9530724]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:44 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 Jul 11 04:00:44 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:44 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 0 in 0.828s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:45 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:00:45 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Flow 'volume_create_manager' (8287f345-fe78-4c63-9ead-0a58f606784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44689dea-ea44-48be-813a-1b7778b8a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44689dea-ea44-48be-813a-1b7778b8a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1082205246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84638a37-cafe-4b09-9473-1fd7ebdf249d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89dc7072cbf4b08992125de19c29ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:45Z,use_quota=True,user_id='d7cec1f86c464baead78c650089e4bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16072d27-baab-4c68-ad0f-a9be8bdadf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16072d27-baab-4c68-ad0f-a9be8bdadf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eaae69-fea2-4c86-b21a-d25edca28d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64eaae69-fea2-4c86-b21a-d25edca28d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84638a37-cafe-4b09-9473-1fd7ebdf249d', 'volume_name': 'volume-84638a37-cafe-4b09-9473-1fd7ebdf249d', 'volume_size': 2}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a018de-f660-4cee-bf42-f6f8519f4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a018de-f660-4cee-bf42-f6f8519f4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6f12b3-5fef-440b-a18e-6b562338551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Volume 84638a37-cafe-4b09-9473-1fd7ebdf249d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84638a37-cafe-4b09-9473-1fd7ebdf249d', 'volume_size': 2} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1082205246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84638a37-cafe-4b09-9473-1fd7ebdf249d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b89dc7072cbf4b08992125de19c29ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:45Z,use_quota=True,user_id='d7cec1f86c464baead78c650089e4bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Creating volume 84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:45 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d 2147483648 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:45 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d 2147483648 Jul 11 04:00:45 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:45 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604" returned: 0 in 0.829s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:45 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d Jul 11 04:00:45 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:45 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 1 in 0.872s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Downloaded image ece7bdc5-f6f3-4930-84d3-e52a8c010a99 ((None, [{'url': 'file:///opt/stack/data/glance/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'metadata': {}}])) to volume 4a705d88-cd0c-4795-9637-fecdac425924 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Temporary image ece7bdc5-f6f3-4930-84d3-e52a8c010a99 for user 22a75a7df05046fd884aadc4359f4011 is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Marking volume 4a705d88-cd0c-4795-9637-fecdac425924 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Copying metadata from image ece7bdc5-f6f3-4930-84d3-e52a8c010a99 to 4a705d88-cd0c-4795-9637-fecdac425924. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Creating volume glance metadata for volume 4a705d88-cd0c-4795-9637-fecdac425924 backed by image ece7bdc5-f6f3-4930-84d3-e52a8c010a99 with: {'image_id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'image_name': 'tempest-scenario-img--936565358', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b922401a-895e-4d00-b0dc-b2ba6cde39f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a705d88-cd0c-4795-9637-fecdac425924', 'volume_size': 1, 'image_id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--936565358', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6492da05d60f44e9b099435bc8fe65f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ece7bdc5-f6f3-4930-84d3-e52a8c010a99', 'created_at': datetime.datetime(2026, 7, 11, 2, 0, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 0, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece7bdc5-f6f3-4930-84d3-e52a8c010a99/file', 'properties': {}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f43cbc-a9a0-47ad-a716-5b9af2ce4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Volume volume-4a705d88-cd0c-4795-9637-fecdac425924 (4a705d88-cd0c-4795-9637-fecdac425924): created successfully Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f43cbc-a9a0-47ad-a716-5b9af2ce4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Flow 'volume_create_manager' (2ba3e299-8778-478b-9388-c1160ebdd367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5a64f4ad-d3e4-4c83-bc04-3cbe2a8dc58b tempest-TestInstancesWithCinderVolumes-1875975658 None] Created volume successfully. Jul 11 04:00:46 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d 2147483648" returned: 0 in 0.912s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:46 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d Jul 11 04:00:46 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:46 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d" returned: 0 in 0.864s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:46 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d Jul 11 04:00:46 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:46 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6f12b3-5fef-440b-a18e-6b562338551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84638a37-cafe-4b09-9473-1fd7ebdf249d', 'volume_size': 2}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ced678-1d33-4a16-b26d-0a8ebc730645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:46 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Volume volume-84638a37-cafe-4b09-9473-1fd7ebdf249d (84638a37-cafe-4b09-9473-1fd7ebdf249d): created successfully Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ced678-1d33-4a16-b26d-0a8ebc730645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Flow 'volume_create_manager' (8287f345-fe78-4c63-9ead-0a58f606784f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-82aab569-5d39-409f-800c-27bf2681b612 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Created volume successfully. Jul 11 04:00:47 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604.85972378-d879-4fad-bbaf-a64db487627d" returned: 0 in 0.745s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-85972378-d879-4fad-bbaf-a64db487627d" released by "_delete_snapshot" :: held 3.455s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-84aef291-25a6-4c7a-b953-70807a824604" released by "delete_snapshot" :: held 3.493s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['01dd2298-0a24-4d04-a7c7-ba17e225990a', 'fea741d6-2b8c-47df-830c-c9c02e2d2e79', '6b62a329-ba43-4a7a-b773-a9637abf4bc7', 'd331e4b6-b71b-405d-ac25-b89fdd88050b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Delete snapshot completed successfully. Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2591593e-93fe-46a9-aece-edbc9c1aba8a tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-85972378-d879-4fad-bbaf-a64db487627d-delete_snapshot" released by "delete_snapshot" :: held 3.710s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Creating offline snapshot 6232d95f-369a-4498-9bf6-9599aa0fa30d of volume 84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd02ce0-3de3-4d83-9085-05dfca41b15a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:47 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d Jul 11 04:00:47 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:48 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d" returned: 0 in 0.877s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d 2G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:48 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d 2G Jul 11 04:00:48 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (e61e5f77-a584-4916-97a2-42814117b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc36cad-39ce-483e-a3b1-4b56ddd37010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc36cad-39ce-483e-a3b1-4b56ddd37010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-967573645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f077f36d-905a-4ff5-9359-4ab8c689ed8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:49Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460c0032-b4e0-4537-8d7b-940b95d776e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460c0032-b4e0-4537-8d7b-940b95d776e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35af357-73fd-41ae-a8e6-a4f8848ef7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35af357-73fd-41ae-a8e6-a4f8848ef7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f077f36d-905a-4ff5-9359-4ab8c689ed8e', 'volume_name': 'volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be04a09-ef61-4275-9504-1e7247666687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be04a09-ef61-4275-9504-1e7247666687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31217cee-0f92-4f9f-8227-53f9a26bcf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:48 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Volume f077f36d-905a-4ff5-9359-4ab8c689ed8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e', 'volume_size': 1} Jul 11 04:00:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:49 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d 2G" returned: 0 in 0.841s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84638a37-cafe-4b09-9473-1fd7ebdf249d -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:49 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84638a37-cafe-4b09-9473-1fd7ebdf249d -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d Jul 11 04:00:49 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:49 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84638a37-cafe-4b09-9473-1fd7ebdf249d -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:49 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d is being set with open permissions: ugo+rw Jul 11 04:00:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:49 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d Jul 11 04:00:49 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:50 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d" returned: 0 in 0.688s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:50 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info Jul 11 04:00:50 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:51 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info" returned: 0 in 0.669s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:51 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info is being set with open permissions: ugo+rw Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:51 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info Jul 11 04:00:51 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:51 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.info" returned: 0 in 0.620s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.484s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-967573645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f077f36d-905a-4ff5-9359-4ab8c689ed8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:00:49Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Creating volume f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:00:51 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:00:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:51 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e 1073741824 Jul 11 04:00:51 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c0d8a2dd-46c7-42e0-948c-73165e21bee6 tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Create snapshot completed successfully Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "cinder-6232d95f-369a-4498-9bf6-9599aa0fa30d-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-6232d95f-369a-4498-9bf6-9599aa0fa30d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "cinder-quobyte-84638a37-cafe-4b09-9473-1fd7ebdf249d" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-quobyte-84638a37-cafe-4b09-9473-1fd7ebdf249d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "cinder-quobyte-6232d95f-369a-4498-9bf6-9599aa0fa30d" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-quobyte-6232d95f-369a-4498-9bf6-9599aa0fa30d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Deleting offline snapshot 6232d95f-369a-4498-9bf6-9599aa0fa30d of volume 84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] snapshot_file for this snap is: volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25f2716-6a39-4220-8285-649044a70ba1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:52 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e 1073741824" returned: 0 in 0.974s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:52 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d Jul 11 04:00:52 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:52 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:00:52 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:53 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 0.846s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31217cee-0f92-4f9f-8227-53f9a26bcf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd592fb-2d19-4981-8115-304c105107cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:00:53 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Volume volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e (f077f36d-905a-4ff5-9359-4ab8c689ed8e): created successfully Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cd592fb-2d19-4981-8115-304c105107cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (e61e5f77-a584-4916-97a2-42814117b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:00:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1decf60f-580a-47cd-97de-631a04c42d61 tempest-VolumesSnapshotTestJSON-383750334 None] Created volume successfully. Jul 11 04:00:53 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d" returned: 0 in 1.049s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84638a37-cafe-4b09-9473-1fd7ebdf249d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7334b6-bb72-45de-a032-d5014f3f9f64]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:54 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d Jul 11 04:00:54 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[510fa86f-7cef-45aa-ae18-26b06e5a79c9]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:54 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:00:54 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:54 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d" returned: 0 in 0.802s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:54 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d Jul 11 04:00:54 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:55 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 0 in 0.881s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:55 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:00:55 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:55 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d" returned: 0 in 0.902s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:55 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d Jul 11 04:00:55 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:56 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 1 in 0.805s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.756s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.789s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Creating offline snapshot 7dc2014c-1761-44b8-9c40-4f7594cbad02 of volume f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[52012062-e88e-47f3-abda-e8ab908d5966]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-4a705d88-cd0c-4795-9637-fecdac425924', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51f14f8c-41ff-4964-a087-3364f5d316b6', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:00:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-d212f51e-7d4d-460f-a84c-51ae28c71a32 req-41559993-3169-4c9c-be9d-6226a556189b tempest-TestInstancesWithCinderVolumes-1875975658 None] attachment_update completed successfully. Jul 11 04:00:56 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:00:56 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:56 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d.6232d95f-369a-4498-9bf6-9599aa0fa30d" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-quobyte-6232d95f-369a-4498-9bf6-9599aa0fa30d" released by "_delete_snapshot" :: held 3.610s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-quobyte-84638a37-cafe-4b09-9473-1fd7ebdf249d" released by "delete_snapshot" :: held 3.642s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Created reservations ['2a2b9402-ff02-48d3-99b1-90461b8dbf09', '14451bd0-6185-49a6-8071-a7fbaa43b295', '63ac646d-4277-464e-a8a6-b2aa8ce212d3', '6844e332-7601-48f2-b2f3-f1ab71f3e757'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Delete snapshot completed successfully. Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-681badaf-5a10-49c7-a66c-4480761a3a3c tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-6232d95f-369a-4498-9bf6-9599aa0fa30d-delete_snapshot" released by "delete_snapshot" :: held 3.789s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:56 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 0.841s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:56 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 1G Jul 11 04:00:56 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "cinder-84638a37-cafe-4b09-9473-1fd7ebdf249d-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-84638a37-cafe-4b09-9473-1fd7ebdf249d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "cinder-quobyte-84638a37-cafe-4b09-9473-1fd7ebdf249d" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-quobyte-84638a37-cafe-4b09-9473-1fd7ebdf249d" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e5c6f-10e2-4f47-91b0-89d67bf613e4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:57 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d Jul 11 04:00:57 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:57 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 1G" returned: 0 in 0.903s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:57 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 Jul 11 04:00:57 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:58 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d" returned: 0 in 0.851s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:58 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d Jul 11 04:00:58 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:58 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:58 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 is being set with open permissions: ugo+rw Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:58 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 Jul 11 04:00:58 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84638a37-cafe-4b09-9473-1fd7ebdf249d" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:58 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-quobyte-84638a37-cafe-4b09-9473-1fd7ebdf249d" released by "delete_volume" :: held 1.624s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Created reservations ['66bde7b1-a45a-45bc-a7ad-f2d14a35170e', '079b31a2-abe2-4de1-a3db-0474669eeb2b', '8a03c239-c7f7-42df-ade9-78de845bbe8f', '1159cd01-fdb7-444b-baa8-e4597900d3cd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:00:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:58 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:00:58 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:59 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02" returned: 0 in 0.799s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:00:59 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info Jul 11 04:00:59 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:00:59 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Jul 11 04:00:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.899s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:00:59 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:00:59 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Deleted volume successfully. Jul 11 04:00:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac039148-a7af-4c79-bdc7-032f75fac4ba tempest-VolumesSnapshotNegativeTestJSON-1173719332 None] Lock "cinder-84638a37-cafe-4b09-9473-1fd7ebdf249d-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:00 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info" returned: 0 in 1.143s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:00 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info is being set with open permissions: ugo+rw Jul 11 04:01:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:00 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info Jul 11 04:01:00 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:01 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.info" returned: 0 in 0.741s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.305s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c62a50fa-9638-40b5-b6c1-a5f3e3356fa4 tempest-VolumesSnapshotTestJSON-383750334 None] Create snapshot completed successfully Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (2c4f881d-4cfa-436d-b65e-7bbb019ac407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbdd96f-e687-4ae8-9aa1-822dd7b53ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbdd96f-e687-4ae8-9aa1-822dd7b53ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1628731624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d2e0ec-ba77-4801-b4ac-30bc19956078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:01:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7dc2014c-1761-44b8-9c40-4f7594cbad02,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:01:02Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792b0289-e8fb-43a5-9f51-205c8380e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792b0289-e8fb-43a5-9f51-205c8380e168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9339718a-b560-4f09-ab05-f2fe8891a7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9339718a-b560-4f09-ab05-f2fe8891a7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20d2e0ec-ba77-4801-b4ac-30bc19956078', 'volume_name': 'volume-20d2e0ec-ba77-4801-b4ac-30bc19956078', 'volume_size': 2, 'snapshot_id': '7dc2014c-1761-44b8-9c40-4f7594cbad02'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8950e6fc-f767-4cc1-a1fc-8b842c7ee4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8950e6fc-f767-4cc1-a1fc-8b842c7ee4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32817f4c-1504-47d3-9681-1fca5c9f4260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:02 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Volume 20d2e0ec-ba77-4801-b4ac-30bc19956078: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20d2e0ec-ba77-4801-b4ac-30bc19956078', 'volume_size': 2, 'snapshot_id': '7dc2014c-1761-44b8-9c40-4f7594cbad02'} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-7dc2014c-1761-44b8-9c40-4f7594cbad02-20d2e0ec-ba77-4801-b4ac-30bc19956078" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7dc2014c-1761-44b8-9c40-4f7594cbad02-20d2e0ec-ba77-4801-b4ac-30bc19956078" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Creating volume 20d2e0ec-ba77-4801-b4ac-30bc19956078 from snapshot 7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-20d2e0ec-ba77-4801-b4ac-30bc19956078" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-20d2e0ec-ba77-4801-b4ac-30bc19956078" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] snapshot: 7dc2014c-1761-44b8-9c40-4f7594cbad02, volume: 20d2e0ec-ba77-4801-b4ac-30bc19956078, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae2f398-ecff-44a4-aa43-4f6790e9e01b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:02 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 Jul 11 04:01:02 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:03 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02" returned: 0 in 1.144s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:01:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:01:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:01:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[10507eb4-c7d4-42c0-888e-c7997f14d74f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:03 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:01:03 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:04 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 1.182s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:04 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:01:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:04 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 Jul 11 04:01:04 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:11 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078" returned: 0 in 7.153s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:11 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb45746-f9ea-4035-bc6a-bd307407c855]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:12 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:01:12 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:12 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=62,cinder:UPDATE=46,cinder:INSERT=21,cinder:DELETE=11 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:01:12 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=67,cinder:UPDATE=66,cinder:INSERT=14,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:01:13 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 1.482s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:13 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:01:13 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Converted 1024.00 MB image at 143.11 MB/s Jul 11 04:01:13 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 is being set with open permissions: ugo+rw Jul 11 04:01:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:13 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 Jul 11 04:01:13 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:14 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:01:14 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:14 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078" returned: 0 in 1.031s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-20d2e0ec-ba77-4801-b4ac-30bc19956078" released by "_copy_volume_from_snapshot" :: held 12.133s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7dc2014c-1761-44b8-9c40-4f7594cbad02-20d2e0ec-ba77-4801-b4ac-30bc19956078" released by "_create_volume_from_snapshot" :: held 12.168s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.190s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32817f4c-1504-47d3-9681-1fca5c9f4260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d2e0ec-ba77-4801-b4ac-30bc19956078', 'volume_size': 2, 'snapshot_id': '7dc2014c-1761-44b8-9c40-4f7594cbad02'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a250d6-c680-4492-9a3b-de136daa40df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:14 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Volume volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 (20d2e0ec-ba77-4801-b4ac-30bc19956078): created successfully Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a250d6-c680-4492-9a3b-de136daa40df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (2c4f881d-4cfa-436d-b65e-7bbb019ac407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:01:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7cdfe422-c6f1-407b-b410-03bc848e1b93 tempest-VolumesSnapshotTestJSON-383750334 None] Created volume successfully. Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-20d2e0ec-ba77-4801-b4ac-30bc19956078-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-20d2e0ec-ba77-4801-b4ac-30bc19956078-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-20d2e0ec-ba77-4801-b4ac-30bc19956078" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-20d2e0ec-ba77-4801-b4ac-30bc19956078" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3676ce8b-1dd4-48b6-983c-5920bca134d0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:15 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.592s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:01:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:01:15 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 Jul 11 04:01:15 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:16 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078" returned: 0 in 1.123s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:16 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078 Jul 11 04:01:16 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:17 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-20d2e0ec-ba77-4801-b4ac-30bc19956078" returned: 0 in 0.839s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-20d2e0ec-ba77-4801-b4ac-30bc19956078" released by "delete_volume" :: held 2.041s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['d0e9dc78-79da-4668-b2ea-c5a3dc0f8e75', '6e1158ac-0cf5-4f85-bc61-4672121dd1e2', '4a658831-0ec3-4ecd-a251-4a37d680214d', '936f2098-70db-45fb-8c91-89c2c07f62f4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:17 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:01:17 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:18 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.122s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:18 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:01:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Deleted volume successfully. Jul 11 04:01:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-18e0c2f9-f595-4796-a06b-aab7a177a443 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-20d2e0ec-ba77-4801-b4ac-30bc19956078-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-7dc2014c-1761-44b8-9c40-4f7594cbad02-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-7dc2014c-1761-44b8-9c40-4f7594cbad02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-f077f36d-905a-4ff5-9359-4ab8c689ed8e" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f077f36d-905a-4ff5-9359-4ab8c689ed8e" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-7dc2014c-1761-44b8-9c40-4f7594cbad02" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7dc2014c-1761-44b8-9c40-4f7594cbad02" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Deleting offline snapshot 7dc2014c-1761-44b8-9c40-4f7594cbad02 of volume f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] snapshot_file for this snap is: volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6c293-4acc-41ba-bb63-7fbf2fede3d2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:19 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 Jul 11 04:01:19 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:20 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02" returned: 0 in 1.120s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:01:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb399921-285e-4e7d-806d-d08b72974438]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:20 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:01:20 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:21 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 1.089s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:21 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 Jul 11 04:01:21 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:22 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02" returned: 0 in 0.878s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:22 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02 Jul 11 04:01:22 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:22 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e.7dc2014c-1761-44b8-9c40-4f7594cbad02" returned: 0 in 0.660s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7dc2014c-1761-44b8-9c40-4f7594cbad02" released by "_delete_snapshot" :: held 3.871s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f077f36d-905a-4ff5-9359-4ab8c689ed8e" released by "delete_snapshot" :: held 3.910s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['6ca82723-48e8-4c3c-96fd-9ffeff8d4fd7', '1da5bdff-1899-4fe2-b23a-8c1d0d44350e', '5446bd17-ed89-4ddf-b641-cb38a939cdf5', '9f3e3ee8-d903-43c7-b7f9-7b2abfa7e247'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Delete snapshot completed successfully. Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92578c8b-ecaf-4d8c-8109-3c49c2ce3fc4 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-7dc2014c-1761-44b8-9c40-4f7594cbad02-delete_snapshot" released by "delete_snapshot" :: held 4.063s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-f077f36d-905a-4ff5-9359-4ab8c689ed8e-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-f077f36d-905a-4ff5-9359-4ab8c689ed8e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-f077f36d-905a-4ff5-9359-4ab8c689ed8e" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f077f36d-905a-4ff5-9359-4ab8c689ed8e" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7df1e8-a513-4937-9b48-16935e7eb92f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:23 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:01:23 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:24 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:24 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e Jul 11 04:01:24 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:25 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f077f36d-905a-4ff5-9359-4ab8c689ed8e" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f077f36d-905a-4ff5-9359-4ab8c689ed8e" released by "delete_volume" :: held 1.636s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['9018600a-120d-48db-93ca-2b1610b87faa', '5664f784-cfef-41bf-bfe5-c0d22498fbd6', '529d5d7f-582a-4703-bcd1-395a3b2ee857', '50442f1d-ceed-4a14-9133-39c886bfbfd7'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:25 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:01:25 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:26 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.864s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:01:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Deleted volume successfully. Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16560cd0-340f-4c95-8b64-4daaa19ebea1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-f077f36d-905a-4ff5-9359-4ab8c689ed8e-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (30647f44-f17d-4db5-8678-05f1790fa0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29520f7a-3f17-429b-a96f-0caeee7a53c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29520f7a-3f17-429b-a96f-0caeee7a53c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1739011812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312665ac-3178-4366-9031-f96b6ca8f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:01:26Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494f71cc-b307-412e-88eb-0a52494cfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494f71cc-b307-412e-88eb-0a52494cfcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8dc83b-a2bf-417d-852e-61d7807aa52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8dc83b-a2bf-417d-852e-61d7807aa52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312665ac-3178-4366-9031-f96b6ca8f37b', 'volume_name': 'volume-312665ac-3178-4366-9031-f96b6ca8f37b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb5143a-859c-4fc0-b3e6-b896e26d6653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb5143a-859c-4fc0-b3e6-b896e26d6653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954e393e-6b1c-4bbe-8ec7-833ecc8de8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Volume 312665ac-3178-4366-9031-f96b6ca8f37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312665ac-3178-4366-9031-f96b6ca8f37b', 'volume_size': 1} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1739011812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312665ac-3178-4366-9031-f96b6ca8f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:01:26Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Creating volume 312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:01:26 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:01:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:26 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b 1073741824 Jul 11 04:01:26 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:27 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b 1073741824" returned: 0 in 1.228s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:27 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:27 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:28 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 0.835s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954e393e-6b1c-4bbe-8ec7-833ecc8de8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312665ac-3178-4366-9031-f96b6ca8f37b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17d2b02-4ae2-4ea3-958f-b9099a75f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:28 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Volume volume-312665ac-3178-4366-9031-f96b6ca8f37b (312665ac-3178-4366-9031-f96b6ca8f37b): created successfully Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17d2b02-4ae2-4ea3-958f-b9099a75f500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (30647f44-f17d-4db5-8678-05f1790fa0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:01:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c9f67ba4-9c29-47fe-833c-fcf80f470989 tempest-VolumesSnapshotTestJSON-383750334 None] Created volume successfully. Jul 11 04:01:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Creating offline snapshot 7fe0138b-5151-44c7-9f05-e5b8740bbff1 of volume 312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:01:29 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1514cb4a-fcb0-439e-be48-b4106b921bf5]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:29 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:29 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:30 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 0.823s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:30 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 1G Jul 11 04:01:30 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:31 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 1G" returned: 0 in 0.852s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312665ac-3178-4366-9031-f96b6ca8f37b -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:31 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312665ac-3178-4366-9031-f96b6ca8f37b -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 Jul 11 04:01:31 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:32 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312665ac-3178-4366-9031-f96b6ca8f37b -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:32 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 is being set with open permissions: ugo+rw Jul 11 04:01:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:32 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 Jul 11 04:01:32 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:32 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1" returned: 0 in 0.735s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:33 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info Jul 11 04:01:33 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:33 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:33 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info is being set with open permissions: ugo+rw Jul 11 04:01:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:33 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info Jul 11 04:01:33 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:34 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.info" returned: 0 in 0.631s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.606s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.813s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d351f2-e4b3-429f-9320-07ad2d259c08]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-886d5536-3552-4a24-823f-c61298b9d8ef tempest-VolumesSnapshotTestJSON-383750334 None] Create snapshot completed successfully Jul 11 04:01:34 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 Jul 11 04:01:34 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:35 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939" returned: 0 in 0.767s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-d114d180-4250-42f2-ae4d-b313e3290939', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eabf3fe9-9e02-4be6-8402-cf51ada3b771', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:01:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-804d34fc-c716-4aaa-aff7-254e8ecb5a12 req-7fd0d152-882b-4e5e-9dc2-83cf3da64ccf tempest-TestInstancesWithCinderVolumes-1875975658 None] attachment_update completed successfully. Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (9b7af4ee-8b9c-486e-8eda-0b0dc29733bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e25262-aeea-457b-8e9d-04a2377f243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e25262-aeea-457b-8e9d-04a2377f243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-263843827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d79c53-944f-461e-bb28-5cfd26dcc684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527ed4be0d38468d9bb2cf894c576a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7fe0138b-5151-44c7-9f05-e5b8740bbff1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:01:35Z,use_quota=True,user_id='dda7d3271aa94419bcd007c1674eb0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41774003-551b-454e-81ad-6e1d549ecb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41774003-551b-454e-81ad-6e1d549ecb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bc883c-0752-4b2a-b9ad-b0910e6368b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2bc883c-0752-4b2a-b9ad-b0910e6368b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7d79c53-944f-461e-bb28-5cfd26dcc684', 'volume_name': 'volume-f7d79c53-944f-461e-bb28-5cfd26dcc684', 'volume_size': 1, 'snapshot_id': '7fe0138b-5151-44c7-9f05-e5b8740bbff1'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054b8463-30be-42c8-902d-a481462a2bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054b8463-30be-42c8-902d-a481462a2bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575f4129-5a6d-4732-bec2-e51af7ffaf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Volume f7d79c53-944f-461e-bb28-5cfd26dcc684: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7d79c53-944f-461e-bb28-5cfd26dcc684', 'volume_size': 1, 'snapshot_id': '7fe0138b-5151-44c7-9f05-e5b8740bbff1'} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-7fe0138b-5151-44c7-9f05-e5b8740bbff1-f7d79c53-944f-461e-bb28-5cfd26dcc684" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7fe0138b-5151-44c7-9f05-e5b8740bbff1-f7d79c53-944f-461e-bb28-5cfd26dcc684" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Creating volume f7d79c53-944f-461e-bb28-5cfd26dcc684 from snapshot 7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-f7d79c53-944f-461e-bb28-5cfd26dcc684" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f7d79c53-944f-461e-bb28-5cfd26dcc684" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] snapshot: 7fe0138b-5151-44c7-9f05-e5b8740bbff1, volume: f7d79c53-944f-461e-bb28-5cfd26dcc684, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd30bb-11f3-44d8-a69b-52f6efbdfcac]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:35 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 Jul 11 04:01:35 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:36 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1" returned: 0 in 0.883s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312665ac-3178-4366-9031-f96b6ca8f37b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:01:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:01:36 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:01:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[444102b5-18c6-4c96-a75e-512d9cd53211]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:36 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:36 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:37 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 0.782s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:37 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:01:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:37 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 Jul 11 04:01:37 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:43 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684" returned: 0 in 5.836s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b73cd-1cd5-4c28-a99b-7280ba2d8069]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:43 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:43 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:44 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 1.123s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:44 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:01:44 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Converted 1024.00 MB image at 175.43 MB/s Jul 11 04:01:44 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 is being set with open permissions: ugo+rw Jul 11 04:01:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:44 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 Jul 11 04:01:44 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684" returned: 0 in 0.911s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:45 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f7d79c53-944f-461e-bb28-5cfd26dcc684" released by "_copy_volume_from_snapshot" :: held 9.653s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7fe0138b-5151-44c7-9f05-e5b8740bbff1-f7d79c53-944f-461e-bb28-5cfd26dcc684" released by "_create_volume_from_snapshot" :: held 9.686s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.703s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.016s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5159d8f4-43bf-4287-9870-31c454331351]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575f4129-5a6d-4732-bec2-e51af7ffaf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d79c53-944f-461e-bb28-5cfd26dcc684', 'volume_size': 1, 'snapshot_id': '7fe0138b-5151-44c7-9f05-e5b8740bbff1'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2d7c35-566f-4d5c-b80a-d34f4f073108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:01:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Volume volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 (f7d79c53-944f-461e-bb28-5cfd26dcc684): created successfully Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2d7c35-566f-4d5c-b80a-d34f4f073108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Flow 'volume_create_manager' (9b7af4ee-8b9c-486e-8eda-0b0dc29733bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:01:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-afc23710-4cc1-4f28-91aa-191b7ac74732 tempest-VolumesSnapshotTestJSON-383750334 None] Created volume successfully. Jul 11 04:01:45 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 Jul 11 04:01:45 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-f7d79c53-944f-461e-bb28-5cfd26dcc684-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-f7d79c53-944f-461e-bb28-5cfd26dcc684-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-f7d79c53-944f-461e-bb28-5cfd26dcc684" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f7d79c53-944f-461e-bb28-5cfd26dcc684" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d092a5b-c850-406a-ab5b-f039908fad3c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:45 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 Jul 11 04:01:45 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:46 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4" returned: 0 in 0.808s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-974e392a-f839-4dab-b99c-d64acbd9bfc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff96ee2-d027-4202-8e59-8f6179572c12', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:01:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-07cfcd68-8c1a-4f67-81c4-8844bffc6f7f req-abca7ce5-cc7a-4b15-9b27-5c49612885c5 tempest-TestInstancesWithCinderVolumes-1875975658 None] attachment_update completed successfully. Jul 11 04:01:46 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684" returned: 0 in 0.829s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:46 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684 Jul 11 04:01:46 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:47 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f7d79c53-944f-461e-bb28-5cfd26dcc684" returned: 0 in 0.756s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-f7d79c53-944f-461e-bb28-5cfd26dcc684" released by "delete_volume" :: held 1.630s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['297191d4-6b0e-4316-87bc-7e245e2715c1', '76252b1b-b5e8-44cf-abaa-844781f6c1ba', 'faf7b54a-8037-4c8e-82d2-74f817bb8a92', '062b19a1-d563-4241-ac3b-b995e793bded'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:47 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:01:47 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-7fe0138b-5151-44c7-9f05-e5b8740bbff1-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-7fe0138b-5151-44c7-9f05-e5b8740bbff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-312665ac-3178-4366-9031-f96b6ca8f37b" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-312665ac-3178-4366-9031-f96b6ca8f37b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-7fe0138b-5151-44c7-9f05-e5b8740bbff1" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7fe0138b-5151-44c7-9f05-e5b8740bbff1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Deleting offline snapshot 7fe0138b-5151-44c7-9f05-e5b8740bbff1 of volume 312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] snapshot_file for this snap is: volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdb0bc-9c70-44b6-82bf-6530cbce2845]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:48 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 Jul 11 04:01:48 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:48 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.003s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:01:48 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Deleted volume successfully. Jul 11 04:01:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21d46ae9-ce0e-49ad-abf4-858d1a1114c1 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-f7d79c53-944f-461e-bb28-5cfd26dcc684-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:49 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1" returned: 0 in 0.929s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312665ac-3178-4366-9031-f96b6ca8f37b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:01:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[75faeba3-3e4f-4cfa-b881-840e3396e7a6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:49 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:49 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:50 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 0.867s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:50 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 Jul 11 04:01:50 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:51 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1" returned: 0 in 0.984s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:51 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1 Jul 11 04:01:51 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:51 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b.7fe0138b-5151-44c7-9f05-e5b8740bbff1" returned: 0 in 0.747s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-7fe0138b-5151-44c7-9f05-e5b8740bbff1" released by "_delete_snapshot" :: held 3.676s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-312665ac-3178-4366-9031-f96b6ca8f37b" released by "delete_snapshot" :: held 3.714s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['e8cc07f2-7e50-44ff-9d15-0349d636e3d3', '4963a00c-285f-4665-9b1b-db213b929e41', '6bb4a7ce-a33d-4a9c-8e87-f0404f14a98b', '7c77471b-b709-4732-ac65-5735134ce153'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Delete snapshot completed successfully. Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b2d55a6-affd-44dc-af08-f4595f64f9c6 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-7fe0138b-5151-44c7-9f05-e5b8740bbff1-delete_snapshot" released by "delete_snapshot" :: held 3.940s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-312665ac-3178-4366-9031-f96b6ca8f37b-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-312665ac-3178-4366-9031-f96b6ca8f37b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-312665ac-3178-4366-9031-f96b6ca8f37b" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-312665ac-3178-4366-9031-f96b6ca8f37b" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffcb5a6-34f1-48b5-9a5c-e8a0c6ed9b9f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:52 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:52 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:53 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 0.905s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:53 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b Jul 11 04:01:53 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:54 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-312665ac-3178-4366-9031-f96b6ca8f37b" returned: 0 in 0.727s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-312665ac-3178-4366-9031-f96b6ca8f37b" released by "delete_volume" :: held 1.719s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['aa238266-4a5d-4af7-959d-4c107ed66273', 'b41a1126-d037-45a2-a419-9884c59af798', '3f86e96f-afa8-4f00-b49d-30b0fa373f8b', '3fd63208-7225-4222-998d-e182c572c639'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:54 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:01:54 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-84aef291-25a6-4c7a-b953-70807a824604-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-84aef291-25a6-4c7a-b953-70807a824604-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "cinder-quobyte-84aef291-25a6-4c7a-b953-70807a824604" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-84aef291-25a6-4c7a-b953-70807a824604" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c55768-c3c2-4ef9-a231-aeba5873c347]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:55 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 Jul 11 04:01:55 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:55 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:01:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Deleted volume successfully. Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9e2f4d74-588e-48fb-8ac4-83e1d1310074 tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-312665ac-3178-4366-9031-f96b6ca8f37b-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-07cb8a29-b2c2-4b46-991d-9862a69db219 req-5cd822c0-2b14-4e34-9e65-62b34346bab3 tempest-TestInstancesWithCinderVolumes-1875975658 None] Terminate volume connection completed successfully. Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-07cb8a29-b2c2-4b46-991d-9862a69db219 req-5cd822c0-2b14-4e34-9e65-62b34346bab3 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deleting attachment eabf3fe9-9e02-4be6-8402-cf51ada3b771. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:01:55 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604" returned: 0 in 0.835s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:55 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604 Jul 11 04:01:55 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:56 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-84aef291-25a6-4c7a-b953-70807a824604" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-quobyte-84aef291-25a6-4c7a-b953-70807a824604" released by "delete_volume" :: held 1.582s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Created reservations ['26bd9943-a618-4187-a57d-25e76f8fb252', 'bd8bbabb-e218-4b99-a0a8-e216f826984f', 'a5a9eb58-a879-4a78-b251-0c89467471f5', 'bf841bd9-cc8c-456b-b6ce-30ebf0b242bb'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:01:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:56 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:01:56 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:57 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:01:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Deleted volume successfully. Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-203218a8-076a-4692-becf-5b924aeecb7b tempest-VolumesSnapshotTestJSON-383750334 None] Lock "cinder-84aef291-25a6-4c7a-b953-70807a824604-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "cinder-d114d180-4250-42f2-ae4d-b313e3290939-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-d114d180-4250-42f2-ae4d-b313e3290939-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "cinder-quobyte-d114d180-4250-42f2-ae4d-b313e3290939" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-quobyte-d114d180-4250-42f2-ae4d-b313e3290939" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4e6dd6-f120-4d4e-87e1-7e0888c499f4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:01:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:58 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 Jul 11 04:01:58 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:58 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939" returned: 0 in 0.952s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:01:59 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939 Jul 11 04:01:59 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:01:59 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 11 04:01:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d114d180-4250-42f2-ae4d-b313e3290939" returned: 0 in 0.895s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:01:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-quobyte-d114d180-4250-42f2-ae4d-b313e3290939" released by "delete_volume" :: held 1.904s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:01:59 devstack cinder-volume[87437]: WARNING cinder.quota [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1225924403-2080182196 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1225924403-2080182196, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:01:59 devstack cinder-volume[87437]: WARNING cinder.quota [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1225924403-2080182196 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1225924403-2080182196, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:01:59 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Created reservations ['0916fcba-8b79-40a5-82f9-88029d8833b0', '5993d75c-4e7c-4e2f-953b-389cbd62a8c9', 'b907ea35-9678-4233-96ce-fdcd71022843', '54c19242-6abd-4168-b196-9c813f88460c'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:00 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:00 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:00 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.802s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:00 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deleted volume successfully. Jul 11 04:02:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c36ce6eb-8e7e-458a-8d23-f88dd5923767 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-d114d180-4250-42f2-ae4d-b313e3290939-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-27659431-77d1-4bca-b4ac-81a77dab4096 req-12553a06-a5af-4f94-9b63-22497d743dcd tempest-TestInstancesWithCinderVolumes-1875975658 None] Terminate volume connection completed successfully. Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-27659431-77d1-4bca-b4ac-81a77dab4096 req-12553a06-a5af-4f94-9b63-22497d743dcd tempest-TestInstancesWithCinderVolumes-1875975658 None] Deleting attachment aff96ee2-d027-4202-8e59-8f6179572c12. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (577a3523-514e-46ff-9aae-a6f74cbf39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdbdc16-0799-4edf-bf98-b9cfc5f932e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdbdc16-0799-4edf-bf98-b9cfc5f932e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768493273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad71a85-511a-41f4-b509-5c57bb95d260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:04Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e72fb6-c0d8-4502-a048-c55f1ac966fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e72fb6-c0d8-4502-a048-c55f1ac966fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100dfb90-1975-470d-85fc-cd4aec825cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100dfb90-1975-470d-85fc-cd4aec825cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad71a85-511a-41f4-b509-5c57bb95d260', 'volume_name': 'volume-2ad71a85-511a-41f4-b509-5c57bb95d260', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d66590-3916-4d41-9250-07e88a26b826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d66590-3916-4d41-9250-07e88a26b826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a67c176-a142-4948-96ca-ffef40c49da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Volume 2ad71a85-511a-41f4-b509-5c57bb95d260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad71a85-511a-41f4-b509-5c57bb95d260', 'volume_size': 1} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768493273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad71a85-511a-41f4-b509-5c57bb95d260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:04Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Creating volume 2ad71a85-511a-41f4-b509-5c57bb95d260 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:02:03 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:02:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:04 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 1073741824 Jul 11 04:02:04 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (6b5646db-44aa-4554-885c-58931a98983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bddcbb9-2d6e-4653-a608-9fc39651c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bddcbb9-2d6e-4653-a608-9fc39651c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831921159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a1ab9b-9fd8-4f24-929f-8d380ffde691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:04Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6542fb3a-8e94-4168-9fec-89675892288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6542fb3a-8e94-4168-9fec-89675892288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0538d172-f69c-4464-a7ef-3008991cc1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0538d172-f69c-4464-a7ef-3008991cc1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a1ab9b-9fd8-4f24-929f-8d380ffde691', 'volume_name': 'volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c3f11-6337-4b31-91c7-cb1bcb2c9103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968c3f11-6337-4b31-91c7-cb1bcb2c9103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ea6258-62fd-45f2-8bd3-636369f29cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Volume 56a1ab9b-9fd8-4f24-929f-8d380ffde691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691', 'volume_size': 1} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (7e16f0ba-5656-49e9-9cad-64dba135f5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92684dd6-35d6-4075-a0bc-508ec94166c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92684dd6-35d6-4075-a0bc-508ec94166c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665350898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a99448-2804-42bc-aa39-e1f5b3f6eb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:05Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad32e409-af26-4ba5-a963-4eb3a1a4fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad32e409-af26-4ba5-a963-4eb3a1a4fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d35c26-814c-4a23-99f0-344b9ff6708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d35c26-814c-4a23-99f0-344b9ff6708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a99448-2804-42bc-aa39-e1f5b3f6eb96', 'volume_name': 'volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d137a2-49b4-4f25-b584-4534740c9e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d137a2-49b4-4f25-b584-4534740c9e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176eba78-e751-4c27-a6a8-0afe2341936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Volume c0a99448-2804-42bc-aa39-e1f5b3f6eb96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96', 'volume_size': 1} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:04 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 1073741824" returned: 0 in 0.952s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:05 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 Jul 11 04:02:05 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (0e59f3d3-5446-4482-ac7d-481848cbd944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc65e28a-5e5d-4031-80c1-94efc577a633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc65e28a-5e5d-4031-80c1-94efc577a633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424596761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66716e0-70c1-43cf-be85-0751560693c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:05Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c3194a-d5cf-4cf0-bf7a-f02a0d5a7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c3194a-d5cf-4cf0-bf7a-f02a0d5a7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38b2696-013a-4dfa-b6ec-0f3ca17df416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38b2696-013a-4dfa-b6ec-0f3ca17df416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66716e0-70c1-43cf-be85-0751560693c3', 'volume_name': 'volume-a66716e0-70c1-43cf-be85-0751560693c3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd37556-fc31-4536-8cd2-f98b82f73a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd37556-fc31-4536-8cd2-f98b82f73a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6952cb-d4c9-446d-8664-081e77de753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Volume a66716e0-70c1-43cf-be85-0751560693c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66716e0-70c1-43cf-be85-0751560693c3', 'volume_size': 1} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (9b9f9a4c-b36d-4a88-b8eb-cccce4e7583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5860b0f1-0145-4c93-9478-a9d4f8a5dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5860b0f1-0145-4c93-9478-a9d4f8a5dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52837941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf502c3-1fb8-4e35-9c46-abf1425c9d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:05Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50b180-6923-4765-8720-9acdc7da2052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50b180-6923-4765-8720-9acdc7da2052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259dbdd4-fb23-4c3d-8677-e5f132f41b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259dbdd4-fb23-4c3d-8677-e5f132f41b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf502c3-1fb8-4e35-9c46-abf1425c9d6a', 'volume_name': 'volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09528203-b3f7-4c3d-b0ab-2f6cc3c37f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09528203-b3f7-4c3d-b0ab-2f6cc3c37f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064b4561-8fe0-4679-ab28-c2de5811ef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Volume baf502c3-1fb8-4e35-9c46-abf1425c9d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a', 'volume_size': 1} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "cinder-974e392a-f839-4dab-b99c-d64acbd9bfc4-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-974e392a-f839-4dab-b99c-d64acbd9bfc4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "cinder-quobyte-974e392a-f839-4dab-b99c-d64acbd9bfc4" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-quobyte-974e392a-f839-4dab-b99c-d64acbd9bfc4" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[be20523c-7513-4167-b8da-f2123a595936]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:05 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 Jul 11 04:02:05 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:05 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.355s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1831921159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a1ab9b-9fd8-4f24-929f-8d380ffde691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:04Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Creating volume 56a1ab9b-9fd8-4f24-929f-8d380ffde691 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:02:05 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a67c176-a142-4948-96ca-ffef40c49da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad71a85-511a-41f4-b509-5c57bb95d260', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 1073741824 Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdd469e-eb62-469d-8f6e-4701adcfb6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:05 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:05 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Volume volume-2ad71a85-511a-41f4-b509-5c57bb95d260 (2ad71a85-511a-41f4-b509-5c57bb95d260): created successfully Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdd469e-eb62-469d-8f6e-4701adcfb6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (577a3523-514e-46ff-9aae-a6f74cbf39e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-73bdbbf7-79e3-41a9-a25a-d8fd4853f816 tempest-CreateVolumesFromImageTest-420907640 None] Created volume successfully. Jul 11 04:02:06 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4" returned: 0 in 0.848s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:06 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4 Jul 11 04:02:06 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:06 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 1073741824" returned: 0 in 1.006s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:06 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 Jul 11 04:02:06 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:07 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-974e392a-f839-4dab-b99c-d64acbd9bfc4" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-quobyte-974e392a-f839-4dab-b99c-d64acbd9bfc4" released by "delete_volume" :: held 1.682s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:07 devstack cinder-volume[87437]: WARNING cinder.quota [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-332892829-1180401892 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-332892829-1180401892, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:02:07 devstack cinder-volume[87437]: WARNING cinder.quota [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-332892829-1180401892 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-332892829-1180401892, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Created reservations ['eeea7b1e-f08c-404e-9698-afa1d049d0d5', 'c3f35ad6-ce8b-4d3b-b342-4d9f5f00c1ea', '99320c03-ee1f-453e-9336-1f4f0e82b082', 'a029ffa1-d613-4577-a432-d131438ff92e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:07 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:07 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:07 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691" returned: 0 in 0.953s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665350898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a99448-2804-42bc-aa39-e1f5b3f6eb96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:05Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Creating volume c0a99448-2804-42bc-aa39-e1f5b3f6eb96 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:02:07 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ea6258-62fd-45f2-8bd3-636369f29cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:07 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 1073741824 Jul 11 04:02:07 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35c6c9f-6a10-41c1-b470-7fc07e75028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Volume volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 (56a1ab9b-9fd8-4f24-929f-8d380ffde691): created successfully Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35c6c9f-6a10-41c1-b470-7fc07e75028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (6b5646db-44aa-4554-885c-58931a98983c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b6ff1f83-261f-4127-9db8-0395829419ab tempest-CreateVolumesFromImageTest-420907640 None] Created volume successfully. Jul 11 04:02:08 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.085s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:08 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:08 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deleted volume successfully. Jul 11 04:02:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dd118d66-0d78-4714-8140-1bdd266b9333 tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-974e392a-f839-4dab-b99c-d64acbd9bfc4-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:09 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 1073741824" returned: 0 in 1.382s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:09 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 Jul 11 04:02:09 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:09 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96" returned: 0 in 0.731s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.792s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424596761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66716e0-70c1-43cf-be85-0751560693c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:05Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Creating volume a66716e0-70c1-43cf-be85-0751560693c3 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:02:09 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:09 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 1073741824 Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176eba78-e751-4c27-a6a8-0afe2341936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:09 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a4f5fb-5b24-4a81-bae0-4af67a95f752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Volume volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 (c0a99448-2804-42bc-aa39-e1f5b3f6eb96): created successfully Jul 11 04:02:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a4f5fb-5b24-4a81-bae0-4af67a95f752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (7e16f0ba-5656-49e9-9cad-64dba135f5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:10 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5f5ca8c9-6447-4ce3-8f8d-6fa152b107e8 tempest-CreateVolumesFromImageTest-420907640 None] Created volume successfully. Jul 11 04:02:11 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 1073741824" returned: 0 in 1.205s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:11 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 Jul 11 04:02:11 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:11 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3" returned: 0 in 0.705s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.435s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52837941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf502c3-1fb8-4e35-9c46-abf1425c9d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ef07b6a61443579297a7edeafc0ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:05Z,use_quota=True,user_id='9a435b40596c4b78ace1f4f3900c07a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Creating volume baf502c3-1fb8-4e35-9c46-abf1425c9d6a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:02:11 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:11 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a 1073741824 Jul 11 04:02:11 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6952cb-d4c9-446d-8664-081e77de753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66716e0-70c1-43cf-be85-0751560693c3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f88cf9c-3b5f-4255-b140-119629dde492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:11 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Volume volume-a66716e0-70c1-43cf-be85-0751560693c3 (a66716e0-70c1-43cf-be85-0751560693c3): created successfully Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f88cf9c-3b5f-4255-b140-119629dde492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (0e59f3d3-5446-4482-ac7d-481848cbd944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8402d6fe-a9ef-4f70-b79e-7803b79c6c98 tempest-CreateVolumesFromImageTest-420907640 None] Created volume successfully. Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=78,cinder:UPDATE=86,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=97,cinder:SELECT=77,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Flow 'volume_create_manager' (f19d8917-22d0-43a4-8dfa-843b67dfcd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6eaaf3-2159-49e9-b016-f38e4962f4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6eaaf3-2159-49e9-b016-f38e4962f4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-371124795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487712ec-5f9e-4f50-99c5-b4de02dbc7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6577b8852ac544e7b129ec79b9cafd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:12Z,use_quota=True,user_id='08bf3233c82542f49232cd6065a7a1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad0221d-fc81-491d-98ea-0b430aa1a2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad0221d-fc81-491d-98ea-0b430aa1a2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a619437-aff2-411f-b362-1d4f2f574585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a619437-aff2-411f-b362-1d4f2f574585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487712ec-5f9e-4f50-99c5-b4de02dbc7f4', 'volume_name': 'volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93f8bd6-8419-4ddd-9a5f-a1503cb51698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93f8bd6-8419-4ddd-9a5f-a1503cb51698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1077699-b754-4011-a109-68f0567493d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Volume 487712ec-5f9e-4f50-99c5-b4de02dbc7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4', 'volume_size': 1} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:12 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a 1073741824" returned: 0 in 0.907s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:12 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a Jul 11 04:02:12 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-081d750d-78a6-48fa-9cda-5a58eec42dd6 req-a1176fa1-af14-417c-a191-d6d6b4f1ae77 tempest-TestInstancesWithCinderVolumes-1875975658 None] Terminate volume connection completed successfully. Jul 11 04:02:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-081d750d-78a6-48fa-9cda-5a58eec42dd6 req-a1176fa1-af14-417c-a191-d6d6b4f1ae77 tempest-TestInstancesWithCinderVolumes-1875975658 None] Deleting attachment 51f14f8c-41ff-4964-a087-3364f5d316b6. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:02:13 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a" returned: 0 in 0.665s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-371124795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487712ec-5f9e-4f50-99c5-b4de02dbc7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6577b8852ac544e7b129ec79b9cafd05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:02:12Z,use_quota=True,user_id='08bf3233c82542f49232cd6065a7a1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Creating volume 487712ec-5f9e-4f50-99c5-b4de02dbc7f4 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:02:13 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064b4561-8fe0-4679-ab28-c2de5811ef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:13 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 1073741824 Jul 11 04:02:13 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c36ee13-47ec-4ee2-b523-4f6f450ff71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:13 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Volume volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a (baf502c3-1fb8-4e35-9c46-abf1425c9d6a): created successfully Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c36ee13-47ec-4ee2-b523-4f6f450ff71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Flow 'volume_create_manager' (9b9f9a4c-b36d-4a88-b8eb-cccce4e7583a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dc11ffad-6d91-4087-9da8-23b4458f7682 tempest-CreateVolumesFromImageTest-420907640 None] Created volume successfully. Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:14 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:14 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-baf502c3-1fb8-4e35-9c46-abf1425c9d6a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-baf502c3-1fb8-4e35-9c46-abf1425c9d6a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:14 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 1073741824" returned: 0 in 0.904s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-quobyte-baf502c3-1fb8-4e35-9c46-abf1425c9d6a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-baf502c3-1fb8-4e35-9c46-abf1425c9d6a" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b3820d-d1a5-4665-ba6c-09672e6259da]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:14 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 Jul 11 04:02:14 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:14 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a Jul 11 04:02:14 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:14 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:02:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:02:15 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" returned: 0 in 0.718s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1077699-b754-4011-a109-68f0567493d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88298def-945e-4951-a1f4-90afe4dda890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:02:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Volume volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 (487712ec-5f9e-4f50-99c5-b4de02dbc7f4): created successfully Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88298def-945e-4951-a1f4-90afe4dda890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Flow 'volume_create_manager' (f19d8917-22d0-43a4-8dfa-843b67dfcd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:02:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dfed362b-13e6-4152-ae63-a2985a49a10e tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Created volume successfully. Jul 11 04:02:15 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a" returned: 0 in 0.874s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:15 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a Jul 11 04:02:15 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:16 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-baf502c3-1fb8-4e35-9c46-abf1425c9d6a" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-baf502c3-1fb8-4e35-9c46-abf1425c9d6a" released by "delete_volume" :: held 1.606s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Created reservations ['414a5a07-6524-475a-a310-702dad0fdc8a', '42036a20-9fd2-4ab4-a38b-97414a4a8b6e', '153a07f6-3df0-403a-b856-681487310986', '3a9f0b21-8a41-405b-9d78-1e688355bfe8'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:16 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:16 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "cinder-4a705d88-cd0c-4795-9637-fecdac425924-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-4a705d88-cd0c-4795-9637-fecdac425924-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "cinder-quobyte-4a705d88-cd0c-4795-9637-fecdac425924" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-quobyte-4a705d88-cd0c-4795-9637-fecdac425924" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[88065f09-16d3-47d2-9363-e57160e1e6d7]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-a66716e0-70c1-43cf-be85-0751560693c3-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-a66716e0-70c1-43cf-be85-0751560693c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-quobyte-a66716e0-70c1-43cf-be85-0751560693c3" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:16 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:02:16 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-a66716e0-70c1-43cf-be85-0751560693c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8bf669-7d95-46f7-a6e4-0cc9e68f8d1b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:16 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 Jul 11 04:02:16 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:16 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.734s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Deleted volume successfully. Jul 11 04:02:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ac465672-69f7-4b73-8ad5-9c10e25bf6e8 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-baf502c3-1fb8-4e35-9c46-abf1425c9d6a-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:17 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 0 in 0.827s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:17 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:02:17 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:17 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3" returned: 0 in 0.815s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:17 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3 Jul 11 04:02:17 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:18 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a66716e0-70c1-43cf-be85-0751560693c3" returned: 0 in 0.667s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:18 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 1 in 0.841s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-a66716e0-70c1-43cf-be85-0751560693c3" released by "delete_volume" :: held 1.539s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:18 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924 Jul 11 04:02:18 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Created reservations ['d16fd7fc-312b-42b5-8b3c-ac7b38a666e5', 'faee36eb-6d0f-447c-a832-4092ef7a0fb0', '8cd71164-7038-4a69-a0a2-714fd1ca7a74', '2d5d91d6-f6a4-46fa-85ff-c568869aa353'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:18 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:18 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-c0a99448-2804-42bc-aa39-e1f5b3f6eb96-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:18 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-c0a99448-2804-42bc-aa39-e1f5b3f6eb96-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4a705d88-cd0c-4795-9637-fecdac425924" returned: 0 in 0.716s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-quobyte-4a705d88-cd0c-4795-9637-fecdac425924" released by "delete_volume" :: held 2.468s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d41c86a-2e83-46ec-804b-6df9a942a7f4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-quobyte-c0a99448-2804-42bc-aa39-e1f5b3f6eb96" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:19 devstack cinder-volume[87437]: WARNING cinder.quota [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1380742998-912888174 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1380742998-912888174, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:02:19 devstack cinder-volume[87437]: WARNING cinder.quota [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1380742998-912888174 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1380742998-912888174, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-c0a99448-2804-42bc-aa39-e1f5b3f6eb96" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:19 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.703s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Created reservations ['4e8b25cb-136f-42bc-b153-735284e24ae2', 'dc136903-9ec0-4fe6-b038-43b8c61b4414', '07b4353f-6b2f-404b-b862-e0bb8ab61a64', '0253c116-be84-4f44-83f8-c23290ac0784'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Deleted volume successfully. Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93337b4-0aae-45ba-9b57-a2aca850b776]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:19 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 Jul 11 04:02:19 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d79eefb6-f60e-4f7b-9be3-0e08c38a9b05 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-a66716e0-70c1-43cf-be85-0751560693c3-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:19 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 Jul 11 04:02:19 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:19 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:19 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:19 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" returned: 0 in 0.865s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.889s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72bead35-c0d8-4b81-ab43-58226d22a69b', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:02:19 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96" returned: 0 in 0.827s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:19 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96 Jul 11 04:02:19 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:19 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:19 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Deleted volume successfully. Jul 11 04:02:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-80dcfacc-3fbc-4794-80a2-c91023a9e683 req-f717dcce-5051-43cb-968b-14da5956659d tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] attachment_update completed successfully. Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-536048de-b01e-4a0a-b13e-0bb041eaf82d tempest-TestInstancesWithCinderVolumes-1875975658 None] Lock "cinder-4a705d88-cd0c-4795-9637-fecdac425924-delete_volume" released by "delete_volume" :: held 3.619s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:20 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0a99448-2804-42bc-aa39-e1f5b3f6eb96" returned: 0 in 0.772s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-c0a99448-2804-42bc-aa39-e1f5b3f6eb96" released by "delete_volume" :: held 1.655s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Created reservations ['58dee3ce-dcb5-4110-8ed4-b2b47b58208e', '1eeae81c-73ee-4d76-94ce-690ebb73d8ca', 'ead58794-0c4a-454a-a183-9734b374bb78', '85d224ee-43d5-4af1-ad10-b27573dd8ef0'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:20 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:20 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-56a1ab9b-9fd8-4f24-929f-8d380ffde691-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-56a1ab9b-9fd8-4f24-929f-8d380ffde691-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-quobyte-56a1ab9b-9fd8-4f24-929f-8d380ffde691" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-56a1ab9b-9fd8-4f24-929f-8d380ffde691" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8eeff-d48f-4131-8929-c2886de6ae8d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:21 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 Jul 11 04:02:21 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:21 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.863s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Deleted volume successfully. Jul 11 04:02:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-76fcd838-a3c2-4d82-bc02-dfec61b30fca tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-c0a99448-2804-42bc-aa39-e1f5b3f6eb96-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:22 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691" returned: 0 in 0.878s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:22 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691 Jul 11 04:02:22 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:22 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-56a1ab9b-9fd8-4f24-929f-8d380ffde691" returned: 0 in 0.685s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-56a1ab9b-9fd8-4f24-929f-8d380ffde691" released by "delete_volume" :: held 1.614s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Created reservations ['b788c72d-d617-45bc-839a-016d069d0838', '8a266c28-6880-40e8-ad31-cf5b0979c5b3', '87793465-a276-48fb-9a8d-19f8205ecaf6', '6ebfa39c-0f6d-41db-847f-971f9b385a40'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:23 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:23 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-2ad71a85-511a-41f4-b509-5c57bb95d260-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-2ad71a85-511a-41f4-b509-5c57bb95d260-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "cinder-quobyte-2ad71a85-511a-41f4-b509-5c57bb95d260" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-2ad71a85-511a-41f4-b509-5c57bb95d260" acquired by "delete_volume" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca10ea7d-cce1-40ba-b555-07c9f00aca7a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:23 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 Jul 11 04:02:23 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:23 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.850s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Deleted volume successfully. Jul 11 04:02:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d643da2c-6511-41dc-af59-8a6633d43380 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-56a1ab9b-9fd8-4f24-929f-8d380ffde691-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:24 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260" returned: 0 in 1.020s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:24 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260 Jul 11 04:02:24 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:25 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ad71a85-511a-41f4-b509-5c57bb95d260" returned: 0 in 0.748s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-quobyte-2ad71a85-511a-41f4-b509-5c57bb95d260" released by "delete_volume" :: held 1.843s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Created reservations ['b256a076-19d8-4906-8008-afe34055887c', '4345162a-e05e-4bc2-9f04-6bdf55ce1cef', 'dce07d1e-c7c1-478a-afea-c977e0318e40', '1d29602c-85ee-4854-81d0-ab5a511e27d8'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:25 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:25 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:26 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.209s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:26 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Deleted volume successfully. Jul 11 04:02:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9b1ba1e3-dd61-4dec-8af4-7d393a69df97 tempest-CreateVolumesFromImageTest-420907640 None] Lock "cinder-2ad71a85-511a-41f4-b509-5c57bb95d260-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-35c15414-bc96-4c04-a6da-e9d5ed2782c5 req-1aac3850-00c1-478a-a9ec-9d6ba831b803 tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Terminate volume connection completed successfully. Jul 11 04:02:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-35c15414-bc96-4c04-a6da-e9d5ed2782c5 req-1aac3850-00c1-478a-a9ec-9d6ba831b803 tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Deleting attachment 72bead35-c0d8-4b81-ab43-58226d22a69b. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:02:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Acquiring lock "cinder-487712ec-5f9e-4f50-99c5-b4de02dbc7f4-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "cinder-487712ec-5f9e-4f50-99c5-b4de02dbc7f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Acquiring lock "cinder-quobyte-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:02:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "cinder-quobyte-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:02:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3933ba2a-67a9-417b-8fed-1ff40e37ce01]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:02:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:30 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 Jul 11 04:02:30 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:31 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" returned: 0 in 0.798s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:31 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4 Jul 11 04:02:31 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:31 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" returned: 0 in 0.770s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "cinder-quobyte-487712ec-5f9e-4f50-99c5-b4de02dbc7f4" released by "delete_volume" :: held 1.613s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:31 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Created reservations ['d99895f5-55b4-407d-87ab-32b0e540ecb9', '6da49e32-3fc0-4029-9b35-436a7ed13fde', 'eba2279e-9c67-471c-933b-81d15a9d5ba3', 'dfed6774-cc2d-4dba-94b8-1a6bb9e7bdb3'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:02:32 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:02:32 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:02:32 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.833s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:02:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Deleted volume successfully. Jul 11 04:02:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ebffc4c1-cb80-416a-b7bb-c0f59c94a75f tempest-TestServerVolumeAttachScenarioOldVersion-399268376 None] Lock "cinder-487712ec-5f9e-4f50-99c5-b4de02dbc7f4-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:02:41 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=41,cinder:UPDATE=62,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:02:42 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=49,cinder:UPDATE=63,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (5b6476b8-98f9-440e-9a96-ae773b674d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fc6051-d562-4bfe-9ded-85ab08d816ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fc6051-d562-4bfe-9ded-85ab08d816ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1597133698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae92bdee-3417-4444-862a-432d65e31880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:06Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f7a169-e80c-4c8b-a802-72ada4cfebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f7a169-e80c-4c8b-a802-72ada4cfebfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff2887-aaeb-46ba-b30e-90f84dee6584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff2887-aaeb-46ba-b30e-90f84dee6584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae92bdee-3417-4444-862a-432d65e31880', 'volume_name': 'volume-ae92bdee-3417-4444-862a-432d65e31880', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcadf4f-4337-4cec-9818-4766fe12fcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dcadf4f-4337-4cec-9818-4766fe12fcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c193054-fe9c-4022-a3e2-4bb1ffd2d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:06 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume ae92bdee-3417-4444-862a-432d65e31880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae92bdee-3417-4444-862a-432d65e31880', 'volume_size': 1} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1597133698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae92bdee-3417-4444-862a-432d65e31880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:06Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating volume ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:06 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:06 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 1073741824 Jul 11 04:03:06 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:07 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 1073741824" returned: 0 in 0.949s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:07 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 Jul 11 04:03:07 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:07 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c193054-fe9c-4022-a3e2-4bb1ffd2d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae92bdee-3417-4444-862a-432d65e31880', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a62f66d-abae-4a0f-8cd8-69a8efe347b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:08 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume volume-ae92bdee-3417-4444-862a-432d65e31880 (ae92bdee-3417-4444-862a-432d65e31880): created successfully Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a62f66d-abae-4a0f-8cd8-69a8efe347b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (5b6476b8-98f9-440e-9a96-ae773b674d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:08 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f496c324-13c1-4631-9426-4cde9da387f0 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created volume successfully. Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating offline snapshot 4f9f88c7-bd65-4caf-87d7-b5b2669df70b of volume ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eedaa18-b707-426b-a69d-7d05031ce710]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:08 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 Jul 11 04:03:08 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:09 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880" returned: 0 in 0.822s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:09 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b 1G Jul 11 04:03:09 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:10 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b 1G" returned: 0 in 1.022s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae92bdee-3417-4444-862a-432d65e31880 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:10 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae92bdee-3417-4444-862a-432d65e31880 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b Jul 11 04:03:10 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:11 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae92bdee-3417-4444-862a-432d65e31880 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b" returned: 0 in 0.870s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:11 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b is being set with open permissions: ugo+rw Jul 11 04:03:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:11 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b Jul 11 04:03:11 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:12 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b" returned: 0 in 0.927s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:12 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info Jul 11 04:03:12 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:12 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info" returned: 0 in 0.676s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:12 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info is being set with open permissions: ugo+rw Jul 11 04:03:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:12 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info Jul 11 04:03:12 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:13 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.info" returned: 0 in 0.715s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.133s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-02a87704-d92b-4c00-add9-035af26a9533 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Create snapshot completed successfully Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:14 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:14 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:15 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.048s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (c7ce341a-4782-43e7-976d-5fdee813d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce39b04-a871-44cb-b198-547714e48ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce39b04-a871-44cb-b198-547714e48ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666828410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473ac505-c068-44c6-b713-2bc1f5e5a5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:16Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43858396-40a4-410e-9118-998668cacadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43858396-40a4-410e-9118-998668cacadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e095f3b-cd41-4f59-9246-eae36551e9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e095f3b-cd41-4f59-9246-eae36551e9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '473ac505-c068-44c6-b713-2bc1f5e5a5c6', 'volume_name': 'volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9ae5ec-12a1-45ed-b7fd-3ad7cd2d8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9ae5ec-12a1-45ed-b7fd-3ad7cd2d8b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09cd3e-d7c2-48b5-8c61-ffe2fe5ab846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume 473ac505-c068-44c6-b713-2bc1f5e5a5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6', 'volume_size': 1} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666828410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=473ac505-c068-44c6-b713-2bc1f5e5a5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:16Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating volume 473ac505-c068-44c6-b713-2bc1f5e5a5c6 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:15 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:16 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 1073741824 Jul 11 04:03:16 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (ee865e06-3dea-4ffe-862a-39aa01aea90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2c3387-a5b1-41d1-b3fa-3d62d1e87440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f2c3387-a5b1-41d1-b3fa-3d62d1e87440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540264801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3192f58-9a12-49dd-893b-f930647cc4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:17Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0e8153-5a3f-4ccb-aabe-7fbce44e1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0e8153-5a3f-4ccb-aabe-7fbce44e1012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f002ccd6-32dd-4549-acfc-8bf766852dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f002ccd6-32dd-4549-acfc-8bf766852dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3192f58-9a12-49dd-893b-f930647cc4cd', 'volume_name': 'volume-c3192f58-9a12-49dd-893b-f930647cc4cd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723b78b1-e78e-41a7-8258-5f0d5f9d2a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723b78b1-e78e-41a7-8258-5f0d5f9d2a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988376fe-5436-4c0e-ba4c-932358770d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:16 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume c3192f58-9a12-49dd-893b-f930647cc4cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3192f58-9a12-49dd-893b-f930647cc4cd', 'volume_size': 1} Jul 11 04:03:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (1d789fde-7064-4724-b275-6bc152794a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a755a6-ff10-4e0b-9597-2845331b9b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a755a6-ff10-4e0b-9597-2845331b9b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50975304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553ecc5e-dd22-46ec-ad53-75e7374424dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:18Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa1a128-ab6c-4118-9a3f-3555436d890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa1a128-ab6c-4118-9a3f-3555436d890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38f5d36-7655-4973-ab5d-de23d15c772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38f5d36-7655-4973-ab5d-de23d15c772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553ecc5e-dd22-46ec-ad53-75e7374424dd', 'volume_name': 'volume-553ecc5e-dd22-46ec-ad53-75e7374424dd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1499a10d-77ea-46c9-9c41-993e6ec2af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1499a10d-77ea-46c9-9c41-993e6ec2af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b5026b-0fe4-40bf-a6ee-ba452c8b1c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume 553ecc5e-dd22-46ec-ad53-75e7374424dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553ecc5e-dd22-46ec-ad53-75e7374424dd', 'volume_size': 1} Jul 11 04:03:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:18 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (ed4e3b24-e85f-4118-a9b9-43197532e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86e83c8-24cc-409c-8b18-65d261cbe37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 1073741824" returned: 0 in 2.257s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86e83c8-24cc-409c-8b18-65d261cbe37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810688304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b30a01-e81e-4270-beb0-e8dc6c60f73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:18Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1361825b-32b8-41f5-9fea-9dbae67a93b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1361825b-32b8-41f5-9fea-9dbae67a93b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f42b90-2e50-4915-b0cd-6455f93d78ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f42b90-2e50-4915-b0cd-6455f93d78ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b30a01-e81e-4270-beb0-e8dc6c60f73e', 'volume_name': 'volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bf82e5-5d78-4970-ae63-1f4440b06b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bf82e5-5d78-4970-ae63-1f4440b06b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a3e5bf-81b9-4e96-a079-5b4c4a9c615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume e7b30a01-e81e-4270-beb0-e8dc6c60f73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e', 'volume_size': 1} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:18 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 Jul 11 04:03:18 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Flow 'volume_create_manager' (2587f91d-6035-49f4-885d-873e36ede470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a128aa-50eb-4a24-bdd2-629132b4a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a128aa-50eb-4a24-bdd2-629132b4a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1675805818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1116f95-ccd3-49c2-8143-3a018284fd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2fd033395544bebbc5de9672f2ab86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:18Z,use_quota=True,user_id='81709b4ff5744e378953ee8d7e12849a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504641e1-a146-4904-bb7b-4091f1a21a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504641e1-a146-4904-bb7b-4091f1a21a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bf9f7a-d915-4856-9563-ead5e724dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bf9f7a-d915-4856-9563-ead5e724dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1116f95-ccd3-49c2-8143-3a018284fd68', 'volume_name': 'volume-a1116f95-ccd3-49c2-8143-3a018284fd68', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc918345-c7ce-49ed-8788-3caac7906725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc918345-c7ce-49ed-8788-3caac7906725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e0364d-7d3e-4461-ba6e-ead5b88d8cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Volume a1116f95-ccd3-49c2-8143-3a018284fd68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1116f95-ccd3-49c2-8143-3a018284fd68', 'volume_size': 1} Jul 11 04:03:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (1f51cd05-dead-41c1-b7a3-007071431fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de398a0b-7681-4aaf-81cb-5dbf25666e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de398a0b-7681-4aaf-81cb-5dbf25666e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728390957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ddac4b-c686-4c58-83d1-26ade98da07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:19Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d35386-3df3-44a3-8655-a43247336e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d35386-3df3-44a3-8655-a43247336e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5cf831-3206-4668-890a-8b43d3f56798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5cf831-3206-4668-890a-8b43d3f56798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ddac4b-c686-4c58-83d1-26ade98da07b', 'volume_name': 'volume-b5ddac4b-c686-4c58-83d1-26ade98da07b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13da904-ed82-470d-b8fa-d86e9cdeab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13da904-ed82-470d-b8fa-d86e9cdeab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599e5108-ad3f-4023-8a4c-155812dbd90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:19 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume b5ddac4b-c686-4c58-83d1-26ade98da07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ddac4b-c686-4c58-83d1-26ade98da07b', 'volume_size': 1} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:19 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6" returned: 0 in 1.102s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] <== create_volume: return (3546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.550s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.491s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-540264801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3192f58-9a12-49dd-893b-f930647cc4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:17Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating volume c3192f58-9a12-49dd-893b-f930647cc4cd {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:19 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:19 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd 1073741824 Jul 11 04:03:19 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca09cd3e-d7c2-48b5-8c61-ffe2fe5ab846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab0cd56-ed2b-4705-8bd6-25bbe269160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:19 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 (473ac505-c068-44c6-b713-2bc1f5e5a5c6): created successfully Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab0cd56-ed2b-4705-8bd6-25bbe269160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (c7ce341a-4782-43e7-976d-5fdee813d137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6345c5cf-b716-467e-b1f4-84d97ffd3cc3 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created volume successfully. Jul 11 04:03:20 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd 1073741824" returned: 0 in 1.047s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:20 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd Jul 11 04:03:20 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:21 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd" returned: 0 in 0.803s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.543s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-50975304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553ecc5e-dd22-46ec-ad53-75e7374424dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:18Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating volume 553ecc5e-dd22-46ec-ad53-75e7374424dd {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:21 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:21 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd 1073741824 Jul 11 04:03:21 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988376fe-5436-4c0e-ba4c-932358770d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3192f58-9a12-49dd-893b-f930647cc4cd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759da746-2bcb-4ca5-8327-ae99fd65049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:21 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume volume-c3192f58-9a12-49dd-893b-f930647cc4cd (c3192f58-9a12-49dd-893b-f930647cc4cd): created successfully Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759da746-2bcb-4ca5-8327-ae99fd65049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (ee865e06-3dea-4ffe-862a-39aa01aea90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3c17375f-2b27-47eb-992a-c15678134d46 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created volume successfully. Jul 11 04:03:22 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd 1073741824" returned: 0 in 1.211s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:22 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd Jul 11 04:03:22 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:23 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.143s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810688304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b30a01-e81e-4270-beb0-e8dc6c60f73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:18Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating volume e7b30a01-e81e-4270-beb0-e8dc6c60f73e {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:23 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b5026b-0fe4-40bf-a6ee-ba452c8b1c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553ecc5e-dd22-46ec-ad53-75e7374424dd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1242cff-d6be-4b7c-9e71-9f4f365dd241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:23 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e 1073741824 Jul 11 04:03:23 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:23 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume volume-553ecc5e-dd22-46ec-ad53-75e7374424dd (553ecc5e-dd22-46ec-ad53-75e7374424dd): created successfully Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1242cff-d6be-4b7c-9e71-9f4f365dd241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (1d789fde-7064-4724-b275-6bc152794a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-02fc7161-25b0-4153-99d6-ddac87710b6f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created volume successfully. Jul 11 04:03:24 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e 1073741824" returned: 0 in 0.946s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:24 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e Jul 11 04:03:24 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:25 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e" returned: 0 in 0.748s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.460s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1675805818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1116f95-ccd3-49c2-8143-3a018284fd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2fd033395544bebbc5de9672f2ab86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:18Z,use_quota=True,user_id='81709b4ff5744e378953ee8d7e12849a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Creating volume a1116f95-ccd3-49c2-8143-3a018284fd68 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:25 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:25 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 1073741824 Jul 11 04:03:25 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a3e5bf-81b9-4e96-a079-5b4c4a9c615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c8798a-04d1-4ac1-ab08-1c9ca8d73093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:25 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e (e7b30a01-e81e-4270-beb0-e8dc6c60f73e): created successfully Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c8798a-04d1-4ac1-ab08-1c9ca8d73093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (ed4e3b24-e85f-4118-a9b9-43197532e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:25 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-210af19d-103a-4186-9afa-d3ef3f2e4f5f tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created volume successfully. Jul 11 04:03:26 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 1073741824" returned: 0 in 0.857s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:26 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 Jul 11 04:03:26 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:26 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68" returned: 0 in 0.648s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.483s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728390957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ddac4b-c686-4c58-83d1-26ade98da07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='749edef9ce924badb7709e719665f2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:19Z,use_quota=True,user_id='6636ea3ba05440b29873665204797a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Creating volume b5ddac4b-c686-4c58-83d1-26ade98da07b {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:26 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:26 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b 1073741824 Jul 11 04:03:26 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e0364d-7d3e-4461-ba6e-ead5b88d8cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1116f95-ccd3-49c2-8143-3a018284fd68', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a643b5-5ba8-48a7-92f1-5ece824e6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Volume volume-a1116f95-ccd3-49c2-8143-3a018284fd68 (a1116f95-ccd3-49c2-8143-3a018284fd68): created successfully Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a643b5-5ba8-48a7-92f1-5ece824e6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Flow 'volume_create_manager' (2587f91d-6035-49f4-885d-873e36ede470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-64894bd2-2244-4fe5-9709-45f670261eae tempest-TestMinimumBasicScenario-633613079 None] Created volume successfully. Jul 11 04:03:27 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b 1073741824" returned: 0 in 0.935s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:27 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b Jul 11 04:03:27 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:28 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b" returned: 0 in 0.635s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599e5108-ad3f-4023-8a4c-155812dbd90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ddac4b-c686-4c58-83d1-26ade98da07b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e54773-ef5d-4eec-a7aa-8d2fb735f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:28 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Volume volume-b5ddac4b-c686-4c58-83d1-26ade98da07b (b5ddac4b-c686-4c58-83d1-26ade98da07b): created successfully Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e54773-ef5d-4eec-a7aa-8d2fb735f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Flow 'volume_create_manager' (1f51cd05-dead-41c1-b7a3-007071431fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-df001155-8931-4930-bc84-13fff745209d tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created volume successfully. Jul 11 04:03:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-b5ddac4b-c686-4c58-83d1-26ade98da07b-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-b5ddac4b-c686-4c58-83d1-26ade98da07b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-b5ddac4b-c686-4c58-83d1-26ade98da07b" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-b5ddac4b-c686-4c58-83d1-26ade98da07b" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:29 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6856c-68d7-4e89-a586-774146c815d5]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:29 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b Jul 11 04:03:29 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:30 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b" returned: 0 in 0.799s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:30 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b Jul 11 04:03:30 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858efe0-fd36-4ad7-96d0-b23fd09eb1e3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:30 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 Jul 11 04:03:30 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:30 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b5ddac4b-c686-4c58-83d1-26ade98da07b" returned: 0 in 0.711s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-b5ddac4b-c686-4c58-83d1-26ade98da07b" released by "delete_volume" :: held 1.556s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['7c06faae-95d1-41ac-a8bd-d7b6f325c34d', 'f917602c-0a56-4f0e-b76f-b01c0aedd34f', 'd8ee9f32-64c7-424d-a28a-50c0c8eeb6f8', '542de717-96b5-4561-9eb5-d29e8680c84d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:30 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:30 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:31 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-a1116f95-ccd3-49c2-8143-3a018284fd68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd37ed242-2ef5-445c-b850-b8d304dff47c', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:03:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-749bd251-cbeb-4505-b926-58a6b9e78256 req-0c044e8d-8e2e-41a0-ba67-a8e92b338fa5 tempest-TestMinimumBasicScenario-633613079 None] attachment_update completed successfully. Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-e7b30a01-e81e-4270-beb0-e8dc6c60f73e-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-e7b30a01-e81e-4270-beb0-e8dc6c60f73e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-e7b30a01-e81e-4270-beb0-e8dc6c60f73e" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-e7b30a01-e81e-4270-beb0-e8dc6c60f73e" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a021691f-6868-4f26-b1f0-66103f143c7c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:31 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e Jul 11 04:03:31 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:31 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.911s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleted volume successfully. Jul 11 04:03:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2ffd910f-292f-4878-8056-a88b78436db6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-b5ddac4b-c686-4c58-83d1-26ade98da07b-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:32 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e" returned: 0 in 0.900s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:32 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e Jul 11 04:03:32 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:33 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e7b30a01-e81e-4270-beb0-e8dc6c60f73e" returned: 0 in 0.663s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-e7b30a01-e81e-4270-beb0-e8dc6c60f73e" released by "delete_volume" :: held 1.607s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['304c8a10-b19f-477d-9bd0-e7cb968fa1da', 'f630b236-bf08-4ac9-9ee4-f20824c435bc', 'a8f620a7-7f79-434d-ba41-ef7754433c38', 'a8e05adc-9d07-4a0b-849d-92a4d2309b30'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:33 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:33 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-553ecc5e-dd22-46ec-ad53-75e7374424dd-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-553ecc5e-dd22-46ec-ad53-75e7374424dd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-553ecc5e-dd22-46ec-ad53-75e7374424dd" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-553ecc5e-dd22-46ec-ad53-75e7374424dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8539915-281c-420f-b6f3-bbe7f0693e1a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:33 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd Jul 11 04:03:33 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:34 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.750s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:34 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleted volume successfully. Jul 11 04:03:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ed4d4d34-c4b2-43e9-b5a2-7e609cb23c68 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-e7b30a01-e81e-4270-beb0-e8dc6c60f73e-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:34 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd" returned: 0 in 0.818s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:34 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd Jul 11 04:03:34 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:35 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-553ecc5e-dd22-46ec-ad53-75e7374424dd" returned: 0 in 0.662s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-553ecc5e-dd22-46ec-ad53-75e7374424dd" released by "delete_volume" :: held 1.526s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['f25cfe15-5881-4842-83df-5778a70a6709', 'bb47ee3f-93c1-4ea8-9da0-f9159422e5d1', '050e7116-3f36-4c4b-b8fc-8bf7b109ef9e', 'edf6b2fe-f386-4e01-aa41-2f763d9e50cd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:35 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:35 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-c3192f58-9a12-49dd-893b-f930647cc4cd-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-c3192f58-9a12-49dd-893b-f930647cc4cd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-c3192f58-9a12-49dd-893b-f930647cc4cd" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-c3192f58-9a12-49dd-893b-f930647cc4cd" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc09f0a-a3f8-47c3-99e3-c6e793192c8b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:36 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.782s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:36 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleted volume successfully. Jul 11 04:03:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a06e36aa-a6bc-4e91-9654-a89dd2198f8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-553ecc5e-dd22-46ec-ad53-75e7374424dd-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:36 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd Jul 11 04:03:36 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:37 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd" returned: 0 in 0.852s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:37 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd Jul 11 04:03:37 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:37 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c3192f58-9a12-49dd-893b-f930647cc4cd" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-c3192f58-9a12-49dd-893b-f930647cc4cd" released by "delete_volume" :: held 1.598s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['42cb3c79-5a24-4263-919b-0230fd6e67ef', 'c5a368c9-3e65-493e-b7da-c98da519d279', 'b709d8a9-a988-460d-aec0-aec78c2514c2', '05d3701a-c12b-4b88-93a0-d5f9a0e89f50'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:37 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:37 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-473ac505-c068-44c6-b713-2bc1f5e5a5c6-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-473ac505-c068-44c6-b713-2bc1f5e5a5c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-473ac505-c068-44c6-b713-2bc1f5e5a5c6" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-473ac505-c068-44c6-b713-2bc1f5e5a5c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08f828-6e96-416d-9419-314e30f4f831]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:38 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 Jul 11 04:03:38 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:38 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.798s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleted volume successfully. Jul 11 04:03:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2f815737-fb39-44c0-bdbe-7c5740558a8b tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-c3192f58-9a12-49dd-893b-f930647cc4cd-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:39 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6" returned: 0 in 0.871s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:39 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6 Jul 11 04:03:39 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:40 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-473ac505-c068-44c6-b713-2bc1f5e5a5c6" returned: 0 in 0.911s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-473ac505-c068-44c6-b713-2bc1f5e5a5c6" released by "delete_volume" :: held 1.842s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['ece95d21-22ba-49fc-9d59-744d102079bb', '5947e706-57da-4e7d-b49c-ae49e92c240b', 'e82a8452-f2d4-4370-89d0-8f0d601fbdf0', 'ecfd7e8f-dca0-46a1-9c2a-fc12693f8da0'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:40 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:40 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-4f9f88c7-bd65-4caf-87d7-b5b2669df70b-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-4f9f88c7-bd65-4caf-87d7-b5b2669df70b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-ae92bdee-3417-4444-862a-432d65e31880" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-ae92bdee-3417-4444-862a-432d65e31880" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-4f9f88c7-bd65-4caf-87d7-b5b2669df70b" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-4f9f88c7-bd65-4caf-87d7-b5b2669df70b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleting offline snapshot 4f9f88c7-bd65-4caf-87d7-b5b2669df70b of volume ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] snapshot_file for this snap is: volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cd0e75-7f65-449b-970d-90bc7bd29e0b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:40 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b Jul 11 04:03:40 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:41 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.802s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleted volume successfully. Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3040982a-4358-4437-8337-658c24505796 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-473ac505-c068-44c6-b713-2bc1f5e5a5c6-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:41 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b" returned: 0 in 0.893s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae92bdee-3417-4444-862a-432d65e31880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7c77c2-9a88-4ae4-85cd-d32ade3cc159]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:41 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 Jul 11 04:03:41 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:42 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880" returned: 0 in 0.867s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:42 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b Jul 11 04:03:42 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Flow 'volume_create_manager' (8736c039-323a-46c1-8dca-98647e4ffa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ed58f3-6729-4ff7-aa2a-53ac166b6a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ed58f3-6729-4ff7-aa2a-53ac166b6a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-673056979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a85198b-8637-4eda-bab8-8d153723cdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37fba6f1ef4411292da6cc92ed51100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:43Z,use_quota=True,user_id='748038101967414296fd9f65728d4665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fda2e3-c8b2-4923-9e19-88e53d8739d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fda2e3-c8b2-4923-9e19-88e53d8739d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d2625f-f5f1-4cfc-a3f7-ef58d052ab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d2625f-f5f1-4cfc-a3f7-ef58d052ab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a85198b-8637-4eda-bab8-8d153723cdad', 'volume_name': 'volume-9a85198b-8637-4eda-bab8-8d153723cdad', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8245c0-a618-4d38-98c4-0a3486f08798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8245c0-a618-4d38-98c4-0a3486f08798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7af329e-394b-4a7b-b5a1-9019eaea69c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Volume 9a85198b-8637-4eda-bab8-8d153723cdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a85198b-8637-4eda-bab8-8d153723cdad', 'volume_size': 1} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-673056979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a85198b-8637-4eda-bab8-8d153723cdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37fba6f1ef4411292da6cc92ed51100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:43Z,use_quota=True,user_id='748038101967414296fd9f65728d4665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Creating volume 9a85198b-8637-4eda-bab8-8d153723cdad {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:43 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:43 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad 1073741824 Jul 11 04:03:43 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:43 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b" returned: 0 in 0.909s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:43 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b Jul 11 04:03:43 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:44 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880.4f9f88c7-bd65-4caf-87d7-b5b2669df70b" returned: 0 in 0.757s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:44 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad 1073741824" returned: 0 in 0.983s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-4f9f88c7-bd65-4caf-87d7-b5b2669df70b" released by "_delete_snapshot" :: held 3.569s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-ae92bdee-3417-4444-862a-432d65e31880" released by "delete_snapshot" :: held 3.610s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:44 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad Jul 11 04:03:44 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['39bbeeca-951f-40fd-97d1-b2c04da1916e', '963cfff8-4dfa-4797-a246-57db69292504', 'd2160462-5247-49cb-a13a-a49090d968ae', 'eeec72d7-a56d-4471-b94c-c8315c637dce'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Delete snapshot completed successfully. Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-11c48d67-1e07-43f5-aa2a-e8b5f6dfdff6 tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-4f9f88c7-bd65-4caf-87d7-b5b2669df70b-delete_snapshot" released by "delete_snapshot" :: held 3.771s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-ae92bdee-3417-4444-862a-432d65e31880-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-ae92bdee-3417-4444-862a-432d65e31880-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "cinder-quobyte-ae92bdee-3417-4444-862a-432d65e31880" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-ae92bdee-3417-4444-862a-432d65e31880" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:45 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7af329e-394b-4a7b-b5a1-9019eaea69c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a85198b-8637-4eda-bab8-8d153723cdad', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b33631-3228-4d0d-a65f-b3354442bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc0ade-d45e-4f79-8d04-9c242210470f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Volume volume-9a85198b-8637-4eda-bab8-8d153723cdad (9a85198b-8637-4eda-bab8-8d153723cdad): created successfully Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b33631-3228-4d0d-a65f-b3354442bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Flow 'volume_create_manager' (8736c039-323a-46c1-8dca-98647e4ffa92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d40951c8-f96e-4cc3-8985-68a4816052de tempest-AttachVolumeTestJSON-515024680 None] Created volume successfully. Jul 11 04:03:45 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 Jul 11 04:03:45 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:45 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880" returned: 0 in 0.832s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:45 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880 Jul 11 04:03:45 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:46 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ae92bdee-3417-4444-862a-432d65e31880" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-quobyte-ae92bdee-3417-4444-862a-432d65e31880" released by "delete_volume" :: held 1.594s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Created reservations ['b12379c9-17c6-494d-b8ae-3f33808f125f', '330064f9-2b4f-4985-a0f9-56819b0cea70', 'd19b1979-3a66-4c40-9f2d-fb55cc993a34', '57f86a48-7e9d-4498-a57b-0c056a3ded4c'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:46 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:03:46 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:47 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:47 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:03:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Deleted volume successfully. Jul 11 04:03:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-420ef436-52cc-4c2a-b60d-80b2f727e9af tempest-CreateVolumesFromSnapshotTest-1752251777 None] Lock "cinder-ae92bdee-3417-4444-862a-432d65e31880-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:03:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[62140b28-1ae3-4d39-ac57-431eff916094]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:49 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad Jul 11 04:03:49 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Flow 'volume_create_manager' (a9d90b9c-f734-4cf0-8fbf-2602c03477b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7730614d-e2ed-4bdb-a643-ff9a52ceb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:50 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad" returned: 0 in 0.885s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7730614d-e2ed-4bdb-a643-ff9a52ceb04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2033317636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1adda-d0e0-48e7-8fb7-bec95a2ee741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce977b10a8348dc9f76b904b710edcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:50Z,use_quota=True,user_id='5a59c07a9d364cf8a1d7e5f119a38c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956edbac-439e-4fc9-b293-93bad49df020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956edbac-439e-4fc9-b293-93bad49df020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0662bb75-8e1d-4fae-9913-f18e8776be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0662bb75-8e1d-4fae-9913-f18e8776be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf1adda-d0e0-48e7-8fb7-bec95a2ee741', 'volume_name': 'volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d51ab21-fa0c-4373-917f-590294eacf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d51ab21-fa0c-4373-917f-590294eacf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b2f3d5-d2c8-44f3-94f4-3bf20ce86dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Volume 2bf1adda-d0e0-48e7-8fb7-bec95a2ee741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741', 'volume_size': 1} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2033317636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1adda-d0e0-48e7-8fb7-bec95a2ee741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce977b10a8348dc9f76b904b710edcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:50Z,use_quota=True,user_id='5a59c07a9d364cf8a1d7e5f119a38c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Creating volume 2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:50 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:50 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 1073741824 Jul 11 04:03:50 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-9a85198b-8637-4eda-bab8-8d153723cdad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '765e0b47-6187-40c3-9f09-d2c563e1b179', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:03:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-294aaa10-defc-46c5-93d7-454ddf329977 req-f531242a-97c2-4601-a2d1-72c62f981ae1 tempest-AttachVolumeTestJSON-515024680 None] attachment_update completed successfully. Jul 11 04:03:51 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 1073741824" returned: 0 in 0.858s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:51 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:03:51 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:51 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b2f3d5-d2c8-44f3-94f4-3bf20ce86dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417d3130-f11f-4810-a4a6-1c4059ec0306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:51 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Volume volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 (2bf1adda-d0e0-48e7-8fb7-bec95a2ee741): created successfully Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417d3130-f11f-4810-a4a6-1c4059ec0306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:51 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Flow 'volume_create_manager' (a9d90b9c-f734-4cf0-8fbf-2602c03477b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-91522aba-3461-4468-bfea-b293d157b13d tempest-VolumeDependencyTests-1446332342 None] Created volume successfully. Jul 11 04:03:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Creating offline snapshot af6281ee-025c-4806-b115-46dd42b0a963 of volume 2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:03:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1371e62d-00d5-4a6f-8d6e-8b0017241e1c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:52 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:03:52 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:53 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 0.849s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:53 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 1G Jul 11 04:03:53 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:54 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 1G" returned: 0 in 0.919s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:54 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 Jul 11 04:03:54 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:55 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963" returned: 0 in 0.891s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:55 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 is being set with open permissions: ugo+rw Jul 11 04:03:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:55 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 Jul 11 04:03:55 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:55 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963" returned: 0 in 0.665s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:55 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info Jul 11 04:03:55 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:56 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info" returned: 0 in 0.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:56 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info is being set with open permissions: ugo+rw Jul 11 04:03:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:56 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info Jul 11 04:03:56 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:57 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.info" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.890s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-03dc1122-52ea-4da9-bdc5-ad0f845f2d02 tempest-VolumeDependencyTests-1446332342 None] Create snapshot completed successfully Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Flow 'volume_create_manager' (3db8ccca-e068-4955-b607-94b68f0010fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09dcf5a-4277-48be-9935-d06c097115b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09dcf5a-4277-48be-9935-d06c097115b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1275386306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd22e68-8510-45b7-9a9a-1c9ec5f58a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce977b10a8348dc9f76b904b710edcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af6281ee-025c-4806-b115-46dd42b0a963,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:03:58Z,use_quota=True,user_id='5a59c07a9d364cf8a1d7e5f119a38c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a08742-0d41-4309-9e54-222f696d7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a08742-0d41-4309-9e54-222f696d7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce65cbc2-400c-4d76-9e22-624ab9cd3afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce65cbc2-400c-4d76-9e22-624ab9cd3afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cd22e68-8510-45b7-9a9a-1c9ec5f58a08', 'volume_name': 'volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08', 'volume_size': 1, 'snapshot_id': 'af6281ee-025c-4806-b115-46dd42b0a963'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3786a40-d331-4512-bea0-2c81748d9a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3786a40-d331-4512-bea0-2c81748d9a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc461a-5f3b-41ad-93fb-476f762451dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:03:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Volume 0cd22e68-8510-45b7-9a9a-1c9ec5f58a08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08', 'volume_size': 1, 'snapshot_id': 'af6281ee-025c-4806-b115-46dd42b0a963'} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-quobyte-af6281ee-025c-4806-b115-46dd42b0a963-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-af6281ee-025c-4806-b115-46dd42b0a963-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Creating volume 0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 from snapshot af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-quobyte-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] snapshot: af6281ee-025c-4806-b115-46dd42b0a963, volume: 0cd22e68-8510-45b7-9a9a-1c9ec5f58a08, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6c51a-e6f4-4dae-880c-426afa766e5c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:58 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 Jul 11 04:03:58 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:03:59 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 11 04:03:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963" returned: 0 in 0.807s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:03:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:03:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:03:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:03:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ed024-cb0c-4292-950f-cb111d2799f4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:03:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:03:59 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:03:59 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:00 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 0.778s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:00 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:04:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:00 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 Jul 11 04:04:00 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:06 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" returned: 0 in 6.604s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:06 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3d264-ec1c-40d6-8d52-306802b5eabd]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:06 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:04:06 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:07 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 1.173s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:07 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:04:07 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Converted 1024.00 MB image at 155.02 MB/s Jul 11 04:04:07 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 is being set with open permissions: ugo+rw Jul 11 04:04:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:07 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 Jul 11 04:04:07 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=68,cinder:UPDATE=86,cinder:INSERT=24,cinder:DELETE=11 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=89,cinder:SELECT=80,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:04:08 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" returned: 0 in 0.748s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" released by "_copy_volume_from_snapshot" :: held 10.201s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-af6281ee-025c-4806-b115-46dd42b0a963-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" released by "_create_volume_from_snapshot" :: held 10.233s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.254s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc461a-5f3b-41ad-93fb-476f762451dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08', 'volume_size': 1, 'snapshot_id': 'af6281ee-025c-4806-b115-46dd42b0a963'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be942b0-c917-400b-a977-7c1b9a2b2c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:08 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Volume volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 (0cd22e68-8510-45b7-9a9a-1c9ec5f58a08): created successfully Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be942b0-c917-400b-a977-7c1b9a2b2c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Flow 'volume_create_manager' (3db8ccca-e068-4955-b607-94b68f0010fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:04:08 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-58614368-a836-4112-aadf-e1dc883f8d62 tempest-VolumeDependencyTests-1446332342 None] Created volume successfully. Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-af6281ee-025c-4806-b115-46dd42b0a963-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-af6281ee-025c-4806-b115-46dd42b0a963-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-quobyte-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-quobyte-af6281ee-025c-4806-b115-46dd42b0a963" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-af6281ee-025c-4806-b115-46dd42b0a963" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Deleting offline snapshot af6281ee-025c-4806-b115-46dd42b0a963 of volume 2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] snapshot_file for this snap is: volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5471b2a-2815-4577-ad3b-fc804738eab1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:09 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 Jul 11 04:04:09 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:10 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963" returned: 0 in 0.858s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:04:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[faac64c6-f227-4fd7-8843-4d9e78dd7a62]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:10 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:04:10 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:11 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 0.834s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:11 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 Jul 11 04:04:11 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:12 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963" returned: 0 in 0.816s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:12 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963 Jul 11 04:04:12 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:12 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741.af6281ee-025c-4806-b115-46dd42b0a963" returned: 0 in 0.666s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-af6281ee-025c-4806-b115-46dd42b0a963" released by "_delete_snapshot" :: held 3.283s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" released by "delete_snapshot" :: held 3.317s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:12 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Created reservations ['39b14354-561c-476b-83e7-c46ca6f3e0f9', 'a1e6ebda-7bd9-427f-84d2-cdc377af6257', '251e01e8-df97-4f78-b4d7-7cbbb33689a4', '16111ee4-7f4f-4866-9068-c349e31ac4aa'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Delete snapshot completed successfully. Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4b6a9424-ccc2-4b34-8e54-dd0ae5a76b1b tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-af6281ee-025c-4806-b115-46dd42b0a963-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-quobyte-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b211ec-2bbf-4bd6-9b56-099b23916d65]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:14 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:04:14 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:14 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:04:14 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:14 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 0.805s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:14 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741 Jul 11 04:04:14 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:14 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.706s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:04:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:04:15 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" returned: 0 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741" released by "delete_volume" :: held 1.626s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Created reservations ['d07b7d6e-19c7-428a-8be7-9b9041e5ea22', '20aec095-d666-42bd-9f9d-78cac53d586c', 'a9000946-a3f5-4277-b009-8a666cd5a17c', 'ce4d70b2-8b9b-4a52-a273-34bafc4de0f2'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:15 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:04:15 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "cinder-quobyte-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd5901-b30e-4118-8000-5bf4d9419648]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:16 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.842s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:04:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Deleted volume successfully. Jul 11 04:04:16 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 Jul 11 04:04:16 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0090ad81-ca89-42f1-9636-0a8665014080 tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-2bf1adda-d0e0-48e7-8fb7-bec95a2ee741-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:17 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" returned: 0 in 1.036s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:17 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08 Jul 11 04:04:17 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:18 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" returned: 0 in 0.686s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-quobyte-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08" released by "delete_volume" :: held 1.797s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Created reservations ['83c1e8b8-0b33-403d-95c8-c8ebcf93cea1', 'a3c8de58-5cee-4fb7-9525-e9ccb8720b1d', '39d06030-ed16-422f-9ad5-42b9ce5a118c', 'b95a7527-69cc-4ac9-a362-d9c846c0217d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:18 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:04:18 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-a7cceea2-40bf-48d4-be48-0280d23d9afb req-cef6a1c5-dd27-4c29-b2f5-4f75a877827a tempest-TestMinimumBasicScenario-633613079 None] Terminate volume connection completed successfully. Jul 11 04:04:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-a7cceea2-40bf-48d4-be48-0280d23d9afb req-cef6a1c5-dd27-4c29-b2f5-4f75a877827a tempest-TestMinimumBasicScenario-633613079 None] Deleting attachment d37ed242-2ef5-445c-b850-b8d304dff47c. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:04:19 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.916s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:19 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:04:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Deleted volume successfully. Jul 11 04:04:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-381c62d7-7866-4fb0-a2ca-57d945c8652e tempest-VolumeDependencyTests-1446332342 None] Lock "cinder-0cd22e68-8510-45b7-9a9a-1c9ec5f58a08-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Acquiring lock "cinder-a1116f95-ccd3-49c2-8143-3a018284fd68-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Lock "cinder-a1116f95-ccd3-49c2-8143-3a018284fd68-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Acquiring lock "cinder-quobyte-a1116f95-ccd3-49c2-8143-3a018284fd68" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Lock "cinder-quobyte-a1116f95-ccd3-49c2-8143-3a018284fd68" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e6166b-6821-482f-bb7a-5cfe929b4c5c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:21 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 Jul 11 04:04:21 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:21 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68" returned: 0 in 0.837s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:21 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68 Jul 11 04:04:21 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Flow 'volume_create_manager' (8e2d820d-1b2e-45b6-89a1-90124a2881cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da53eac-6176-432c-b4d0-bbe66f625143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da53eac-6176-432c-b4d0-bbe66f625143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c199df-7ea3-4cff-81e0-b56b2106d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210e2977df9949ffab204a5ce77075d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:04:22Z,use_quota=True,user_id='87a03b9d4a894275815964c912b84fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f1bd0b-69b8-42ab-b335-aab3f37138cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f1bd0b-69b8-42ab-b335-aab3f37138cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0877f1a8-e852-4d5d-807e-fd644c25a667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0877f1a8-e852-4d5d-807e-fd644c25a667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c199df-7ea3-4cff-81e0-b56b2106d320', 'volume_name': 'volume-d9c199df-7ea3-4cff-81e0-b56b2106d320', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14ee774-aaa3-48b0-a7d0-1b08fd9de20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14ee774-aaa3-48b0-a7d0-1b08fd9de20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d8ddd3-fd29-475b-ac90-b591a6939443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:22 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Volume d9c199df-7ea3-4cff-81e0-b56b2106d320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c199df-7ea3-4cff-81e0-b56b2106d320', 'volume_size': 1} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c199df-7ea3-4cff-81e0-b56b2106d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210e2977df9949ffab204a5ce77075d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:04:22Z,use_quota=True,user_id='87a03b9d4a894275815964c912b84fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Creating volume d9c199df-7ea3-4cff-81e0-b56b2106d320 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:04:22 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:22 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 1073741824 Jul 11 04:04:22 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:22 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a1116f95-ccd3-49c2-8143-3a018284fd68" returned: 0 in 0.700s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Lock "cinder-quobyte-a1116f95-ccd3-49c2-8143-3a018284fd68" released by "delete_volume" :: held 1.588s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Created reservations ['e05efe57-9503-4dbe-be0c-7187e5003645', '198cd4e8-a36d-48a0-b3aa-3ecc525ec1b1', '3415ccfd-b58f-47d9-9bc5-ee9bd355a877', '101f4cd0-efaf-43a9-b82a-035623984a84'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:22 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:04:22 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:22 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 1073741824" returned: 0 in 0.862s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:22 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 Jul 11 04:04:22 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:23 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:04:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Deleted volume successfully. Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8817d997-60cf-4c84-8a4f-49b3efafc279 tempest-TestMinimumBasicScenario-633613079 None] Lock "cinder-a1116f95-ccd3-49c2-8143-3a018284fd68-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:23 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320" returned: 0 in 0.710s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d8ddd3-fd29-475b-ac90-b591a6939443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c199df-7ea3-4cff-81e0-b56b2106d320', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc49bd-fbf1-48b4-ab64-89aa584a4ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:23 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Volume volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 (d9c199df-7ea3-4cff-81e0-b56b2106d320): created successfully Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc49bd-fbf1-48b4-ab64-89aa584a4ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Flow 'volume_create_manager' (8e2d820d-1b2e-45b6-89a1-90124a2881cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:04:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-90c7eb2d-4124-4c0b-9065-63d249c68e16 tempest-CinderUnicodeTest-141673690 None] Created volume successfully. Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Flow 'volume_create_manager' (e9f6caf2-6f6d-495b-bb5f-129fd811ba58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d41eab-4d8f-40da-a031-4126b002d427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d41eab-4d8f-40da-a031-4126b002d427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:04:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-56403860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32a3406-55a6-4b6d-9c0c-47a635b69e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210e2977df9949ffab204a5ce77075d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:04:25Z,use_quota=True,user_id='87a03b9d4a894275815964c912b84fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29a2ab6-2d9f-4f61-b51e-a2542d7c71ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29a2ab6-2d9f-4f61-b51e-a2542d7c71ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06eff28-9297-4b99-9ce9-437ac6c665fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06eff28-9297-4b99-9ce9-437ac6c665fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32a3406-55a6-4b6d-9c0c-47a635b69e9d', 'volume_name': 'volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45214a9-a06f-4dc0-918e-04a91d002a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45214a9-a06f-4dc0-918e-04a91d002a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99c79b4-b8a0-4c49-a97d-8546be9ffbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:24 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Volume b32a3406-55a6-4b6d-9c0c-47a635b69e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d', 'volume_size': 1} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:04:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-56403860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32a3406-55a6-4b6d-9c0c-47a635b69e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='210e2977df9949ffab204a5ce77075d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:04:25Z,use_quota=True,user_id='87a03b9d4a894275815964c912b84fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Creating volume b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:04:24 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:04:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:24 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d 1073741824 Jul 11 04:04:24 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:25 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d 1073741824" returned: 0 in 0.995s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:25 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d Jul 11 04:04:25 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:26 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99c79b4-b8a0-4c49-a97d-8546be9ffbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3267639f-9389-42a8-affe-bdd6817f4169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:04:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Volume volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d (b32a3406-55a6-4b6d-9c0c-47a635b69e9d): created successfully Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3267639f-9389-42a8-affe-bdd6817f4169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Flow 'volume_create_manager' (e9f6caf2-6f6d-495b-bb5f-129fd811ba58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:04:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ad9d054e-fbcc-4f76-9faf-1309146ffb90 tempest-CinderUnicodeTest-141673690 None] Created volume successfully. Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Creating offline snapshot acdfe064-4365-42bf-807b-a005d9fa16a9 of volume b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:04:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e99189-4434-4fcb-a6a2-0e7d683030fc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:27 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d Jul 11 04:04:27 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:27 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" returned: 0 in 0.747s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:27 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 1G Jul 11 04:04:27 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:28 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 1G" returned: 0 in 0.783s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:28 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 Jul 11 04:04:28 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:29 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9" returned: 0 in 0.699s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:29 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 is being set with open permissions: ugo+rw Jul 11 04:04:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:29 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 Jul 11 04:04:29 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:29 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:29 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info Jul 11 04:04:29 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:30 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:30 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info is being set with open permissions: ugo+rw Jul 11 04:04:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:30 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info Jul 11 04:04:30 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:31 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.info" returned: 0 in 0.698s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.354s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-bc9b962b-cf76-4034-af05-2253654728c9 tempest-CinderUnicodeTest-141673690 None] Create snapshot completed successfully Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-acdfe064-4365-42bf-807b-a005d9fa16a9-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-acdfe064-4365-42bf-807b-a005d9fa16a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-quobyte-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-quobyte-acdfe064-4365-42bf-807b-a005d9fa16a9" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-acdfe064-4365-42bf-807b-a005d9fa16a9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Deleting offline snapshot acdfe064-4365-42bf-807b-a005d9fa16a9 of volume b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] snapshot_file for this snap is: volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f891d915-71f4-4ff7-b798-bb0c89286331]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:32 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 Jul 11 04:04:32 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-64a467d3-5fe4-47f4-ac80-9807f49a7865 req-296ca0af-cdf7-411a-94d6-bf29da4617b3 tempest-AttachVolumeTestJSON-515024680 None] Terminate volume connection completed successfully. Jul 11 04:04:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-64a467d3-5fe4-47f4-ac80-9807f49a7865 req-296ca0af-cdf7-411a-94d6-bf29da4617b3 tempest-AttachVolumeTestJSON-515024680 None] Deleting attachment 765e0b47-6187-40c3-9f09-d2c563e1b179. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:04:33 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9" returned: 0 in 0.842s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:04:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[442dd6a3-bb2d-46d5-949a-e92b018a8f39]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:33 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d Jul 11 04:04:33 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:34 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" returned: 0 in 0.943s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:34 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 Jul 11 04:04:34 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:34 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9" returned: 0 in 0.780s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:34 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9 Jul 11 04:04:34 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:35 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d.acdfe064-4365-42bf-807b-a005d9fa16a9" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-acdfe064-4365-42bf-807b-a005d9fa16a9" released by "_delete_snapshot" :: held 3.392s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" released by "delete_snapshot" :: held 3.432s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:35 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Created reservations ['2c28ab87-4938-44e8-b15a-1162580a02bb', 'b02bf7ce-e2b1-4d70-978e-efd0f69d7853', 'f9598c48-d84c-4e8a-bc9f-e7701f401330', '7eb4a237-318e-49f9-a194-8f958141a95e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Delete snapshot completed successfully. Jul 11 04:04:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-85a086f5-ccd0-427a-8f9c-e08f15a32e80 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-acdfe064-4365-42bf-807b-a005d9fa16a9-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-b32a3406-55a6-4b6d-9c0c-47a635b69e9d-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-b32a3406-55a6-4b6d-9c0c-47a635b69e9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-quobyte-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabbd8b9-9b22-4038-8bd7-c48690bc43da]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:36 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d Jul 11 04:04:36 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:37 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" returned: 0 in 0.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:37 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d Jul 11 04:04:37 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:38 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-b32a3406-55a6-4b6d-9c0c-47a635b69e9d" released by "delete_volume" :: held 1.672s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Created reservations ['5f68c303-6cb0-4347-8aaf-46714233ab19', '1aed7206-530a-413c-ad2b-69c505319ea6', '7f41b75d-eebb-4116-b626-f8d7b76ac573', 'ae881c3a-15c7-4be8-94e6-1b1324dede6f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:38 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:04:38 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-d9c199df-7ea3-4cff-81e0-b56b2106d320-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Lock "cinder-d9c199df-7ea3-4cff-81e0-b56b2106d320-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Acquiring lock "cinder-quobyte-d9c199df-7ea3-4cff-81e0-b56b2106d320" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-d9c199df-7ea3-4cff-81e0-b56b2106d320" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b8526f-1b2f-4793-bb06-709cb6717ce2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:04:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:39 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 Jul 11 04:04:39 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:39 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.780s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:39 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:04:39 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Deleted volume successfully. Jul 11 04:04:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cbb0dfcd-6e67-4ef9-acfa-efbd8f9e9e90 tempest-CinderUnicodeTest-141673690 None] Lock "cinder-b32a3406-55a6-4b6d-9c0c-47a635b69e9d-delete_volume" released by "delete_volume" :: held 2.714s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:39 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320" returned: 0 in 0.897s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:39 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320 Jul 11 04:04:39 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:40 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9c199df-7ea3-4cff-81e0-b56b2106d320" returned: 0 in 0.710s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Lock "cinder-quobyte-d9c199df-7ea3-4cff-81e0-b56b2106d320" released by "delete_volume" :: held 1.662s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Created reservations ['986cbe07-d2c2-46fd-815b-24b8da10bffc', '4e8fb921-409a-4e9e-9c47-3d5a74f3cac2', '832bf909-2690-40fc-8251-716b1ba7bd85', '527d799e-e8cf-4a14-b7db-7898e111efff'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:04:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:04:40 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:04:40 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:04:41 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 11 04:04:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:04:41 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:04:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Deleted volume successfully. Jul 11 04:04:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-255f68aa-1797-40b1-8188-366c9f05504a tempest-CinderUnicodeTest-141673690 None] Lock "cinder-d9c199df-7ea3-4cff-81e0-b56b2106d320-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:04:50 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=51,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:04:51 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=62,cinder:SELECT=41,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Flow 'volume_create_manager' (2b19f4f1-ede9-4ae9-a583-98f1625d4d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63318673-7618-4742-a2b9-a3cdffd31875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63318673-7618-4742-a2b9-a3cdffd31875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1763972400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f973fe-c250-40eb-83b5-ce89310ae399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ee97a7c3494775a736706fcc86303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:05:09Z,use_quota=True,user_id='43512a3211bf49938a35ad914076ccb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51638203-d9cd-4e68-a031-648ea0de4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51638203-d9cd-4e68-a031-648ea0de4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272ef678-b086-4a88-94f0-6040fd136aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272ef678-b086-4a88-94f0-6040fd136aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85f973fe-c250-40eb-83b5-ce89310ae399', 'volume_name': 'volume-85f973fe-c250-40eb-83b5-ce89310ae399', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb7266c-c6a0-4c8d-9ce6-b00849ed1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb7266c-c6a0-4c8d-9ce6-b00849ed1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0db6b70-6338-433f-8825-a873e29ed8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Volume 85f973fe-c250-40eb-83b5-ce89310ae399: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85f973fe-c250-40eb-83b5-ce89310ae399', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:05:09 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Trying to clone 85f973fe-c250-40eb-83b5-ce89310ae399 from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:05:10 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985620e-1ee1-4737-a806-e16bc864fb3e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:10 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD Jul 11 04:05:10 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:10 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 is fetched for user 43512a3211bf49938a35ad914076ccb5. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfb54c6-e204-42d8-8b7a-3eb176711944]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:05:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:11 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD Jul 11 04:05:11 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:11 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1763972400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f973fe-c250-40eb-83b5-ce89310ae399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ee97a7c3494775a736706fcc86303e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:05:09Z,use_quota=True,user_id='43512a3211bf49938a35ad914076ccb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Creating volume 85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:05:11 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:05:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:11 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 1073741824 Jul 11 04:05:11 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:12 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 1073741824" returned: 0 in 0.896s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:12 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:05:12 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:13 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:05:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:05:13 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Attempting download of 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume 85f973fe-c250-40eb-83b5-ce89310ae399. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:05:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac3a5d4-5187-41a0-a95a-46f9bad92e27]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:05:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:13 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm Jul 11 04:05:13 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:14 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm" returned: 0 in 0.713s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:14 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:05:14 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:14 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm Jul 11 04:05:14 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:14 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:05:14 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm" returned: 1 in 0.742s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_76aol0hm' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcacb2e7-a15d-41a8-b398-3e4349033476]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:05:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:14 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD Jul 11 04:05:14 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:15 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:15 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] 80fd31bb-c6c3-4f44-9f5f-61edc167e142 was qcow2, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:05:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:15 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:05:15 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:17 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 1.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:17 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_ztczeat3devstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:05:17 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Converted 112.00 MB image at 60.42 MB/s Jul 11 04:05:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:17 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 1G Jul 11 04:05:17 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:18 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 1G" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:18 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec08176e-2d4b-4144-84bf-5065431fec98]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:05:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:18 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:05:18 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:18 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:18 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:05:18 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:19 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 1 in 0.758s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Downloaded image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume 85f973fe-c250-40eb-83b5-ce89310ae399 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 for user 43512a3211bf49938a35ad914076ccb5 is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Marking volume 85f973fe-c250-40eb-83b5-ce89310ae399 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Copying metadata from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 to 85f973fe-c250-40eb-83b5-ce89310ae399. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Creating volume glance metadata for volume 85f973fe-c250-40eb-83b5-ce89310ae399 backed by image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0db6b70-6338-433f-8825-a873e29ed8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85f973fe-c250-40eb-83b5-ce89310ae399', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771bf5e0-ebb4-4b48-8139-d4fffd8a4cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:19 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Volume volume-85f973fe-c250-40eb-83b5-ce89310ae399 (85f973fe-c250-40eb-83b5-ce89310ae399): created successfully Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771bf5e0-ebb4-4b48-8139-d4fffd8a4cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:19 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Flow 'volume_create_manager' (2b19f4f1-ede9-4ae9-a583-98f1625d4d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:05:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ec2a2334-44c2-483d-a42e-1e42a85a0f26 tempest-TestShelveInstance-1890351743 None] Created volume successfully. Jul 11 04:05:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:05:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:05:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e75c901-eec7-4d88-b85b-49eaa8334edd]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:05:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:29 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:05:29 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:29 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:29 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:05:29 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:30 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 1 in 0.998s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:05:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.842s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:05:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-85f973fe-c250-40eb-83b5-ce89310ae399', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1958fc57-e0a0-46bf-bebc-8303f0d67534', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:05:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-aa243561-8daf-42a4-8c07-6cb0b426bcf5 req-1a736092-7f82-47b9-8ee7-c9930941e613 tempest-TestShelveInstance-1890351743 None] attachment_update completed successfully. Jul 11 04:05:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:05:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=7 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Flow 'volume_create_manager' (3e3ed1ee-c79f-47d6-b8bf-ab468efb0a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb5e3c6-9d83-4552-b544-90758513bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb5e3c6-9d83-4552-b544-90758513bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1336767904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a24ac23-e59e-4a82-a1fb-4ead90fc378a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37fba6f1ef4411292da6cc92ed51100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:05:56Z,use_quota=True,user_id='748038101967414296fd9f65728d4665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0c6a7d-cc27-474c-88c0-49743992d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0c6a7d-cc27-474c-88c0-49743992d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda59a07-f76a-4b64-96e8-b7d5db998dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda59a07-f76a-4b64-96e8-b7d5db998dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a24ac23-e59e-4a82-a1fb-4ead90fc378a', 'volume_name': 'volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d74983e-3da8-41b1-88f3-18e17ac27ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d74983e-3da8-41b1-88f3-18e17ac27ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b42298-585f-4723-b60b-ce64850d3050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Volume 1a24ac23-e59e-4a82-a1fb-4ead90fc378a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a', 'volume_size': 1} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1336767904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a24ac23-e59e-4a82-a1fb-4ead90fc378a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37fba6f1ef4411292da6cc92ed51100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:05:56Z,use_quota=True,user_id='748038101967414296fd9f65728d4665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Creating volume 1a24ac23-e59e-4a82-a1fb-4ead90fc378a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:05:56 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:05:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:56 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a 1073741824 Jul 11 04:05:56 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:57 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a 1073741824" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:05:57 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a Jul 11 04:05:57 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:05:57 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b42298-585f-4723-b60b-ce64850d3050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0092cef9-bc8e-4ffc-b6aa-a760ef366d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:05:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Volume volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a (1a24ac23-e59e-4a82-a1fb-4ead90fc378a): created successfully Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0092cef9-bc8e-4ffc-b6aa-a760ef366d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:05:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Flow 'volume_create_manager' (3e3ed1ee-c79f-47d6-b8bf-ab468efb0a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:05:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4ff10f37-eb4b-4171-aa5c-27b5a1f10d49 tempest-AttachVolumeTestJSON-515024680 None] Created volume successfully. Jul 11 04:06:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5836e2-d396-4544-b0c2-f43c52a749d0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:06:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:01 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a Jul 11 04:06:01 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:02 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" returned: 0 in 0.750s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '737e1c36-276a-4d15-88fd-23d91e75e320', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:06:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-abede27e-498c-46b1-9e7a-1e30b4ec7be3 req-b97a5c96-d831-429c-ab2b-4ab9858da2df tempest-AttachVolumeTestJSON-515024680 None] attachment_update completed successfully. Jul 11 04:06:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-662d100a-cca3-4f3c-9284-ebe43dbf5adb req-d3e2769b-a03f-4761-b41e-a7194716dba2 tempest-TestShelveInstance-1890351743 None] Terminate volume connection completed successfully. Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-662d100a-cca3-4f3c-9284-ebe43dbf5adb req-d3e2769b-a03f-4761-b41e-a7194716dba2 tempest-TestShelveInstance-1890351743 None] Deleting attachment 1958fc57-e0a0-46bf-bebc-8303f0d67534. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Flow 'volume_create_manager' (c9ab4f0d-0a0d-439c-ad87-d8df1a37b4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591baaf8-c2f2-4758-ac72-a3fd99b63728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591baaf8-c2f2-4758-ac72-a3fd99b63728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1886780623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d8504c-255a-401a-9b07-51cead58db08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37fba6f1ef4411292da6cc92ed51100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:06:07Z,use_quota=True,user_id='748038101967414296fd9f65728d4665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0588bc6-8e27-4bca-8c97-d361c9678d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0588bc6-8e27-4bca-8c97-d361c9678d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08904a6-931e-4d1c-b0d3-67aea3d283c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08904a6-931e-4d1c-b0d3-67aea3d283c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d8504c-255a-401a-9b07-51cead58db08', 'volume_name': 'volume-44d8504c-255a-401a-9b07-51cead58db08', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677e0f3-b199-4aa5-a98c-c0433a17c0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677e0f3-b199-4aa5-a98c-c0433a17c0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac36159-7405-4d42-a2f1-add5e2d737e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:06:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Volume 44d8504c-255a-401a-9b07-51cead58db08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d8504c-255a-401a-9b07-51cead58db08', 'volume_size': 1} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1886780623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d8504c-255a-401a-9b07-51cead58db08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37fba6f1ef4411292da6cc92ed51100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:06:07Z,use_quota=True,user_id='748038101967414296fd9f65728d4665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Creating volume 44d8504c-255a-401a-9b07-51cead58db08 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:06:07 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:06:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:07 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 1073741824 Jul 11 04:06:07 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:08 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 1073741824" returned: 0 in 0.856s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:08 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 Jul 11 04:06:08 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:09 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08" returned: 0 in 0.672s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac36159-7405-4d42-a2f1-add5e2d737e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d8504c-255a-401a-9b07-51cead58db08', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3749b75a-c29d-4e43-a563-a3012d313a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:06:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Volume volume-44d8504c-255a-401a-9b07-51cead58db08 (44d8504c-255a-401a-9b07-51cead58db08): created successfully Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3749b75a-c29d-4e43-a563-a3012d313a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:06:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Flow 'volume_create_manager' (c9ab4f0d-0a0d-439c-ad87-d8df1a37b4aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:06:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fabc9a91-cd1c-49a8-9a4b-25fcc74c4f4c tempest-AttachVolumeTestJSON-515024680 None] Created volume successfully. Jul 11 04:06:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:12 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86481b4-e325-4c43-bbff-276a3b01adbe]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:06:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:12 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:06:12 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:13 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 0.776s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:13 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:06:13 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:13 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 1 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.524s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.496s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a042cc04-85d8-44c1-9ed8-315f297e7435]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-85f973fe-c250-40eb-83b5-ce89310ae399', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b56e739-89c2-43ba-a876-5f2fce030913', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:06:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-388c6dde-a319-423e-839b-f16238cb6c9d tempest-TestShelveInstance-1890351743 None] attachment_update completed successfully. Jul 11 04:06:14 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 Jul 11 04:06:14 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:14 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:06:14 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:14 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08" returned: 0 in 0.772s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-44d8504c-255a-401a-9b07-51cead58db08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfe25047-7e65-49e3-900a-a9329c651d40', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:06:14 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:06:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:06:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-4952a6c3-988b-4ff2-a981-7cdbcdd046d3 req-b0e80948-7393-478e-a742-85b1f4819f8a tempest-AttachVolumeTestJSON-515024680 None] attachment_update completed successfully. Jul 11 04:06:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-95381977-ca8e-4724-bd43-4208ef060d4e req-110dfc5a-101e-4c08-b7bf-821b777302b9 tempest-AttachVolumeTestJSON-515024680 None] Terminate volume connection completed successfully. Jul 11 04:06:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-95381977-ca8e-4724-bd43-4208ef060d4e req-110dfc5a-101e-4c08-b7bf-821b777302b9 tempest-AttachVolumeTestJSON-515024680 None] Deleting attachment 737e1c36-276a-4d15-88fd-23d91e75e320. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:06:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-c100678f-cb34-4f03-884f-b294ecd25b6d req-1f564b1b-6b39-40a6-9c6e-306b681352d9 tempest-AttachVolumeTestJSON-515024680 None] Terminate volume connection completed successfully. Jul 11 04:06:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-c100678f-cb34-4f03-884f-b294ecd25b6d req-1f564b1b-6b39-40a6-9c6e-306b681352d9 tempest-AttachVolumeTestJSON-515024680 None] Deleting attachment cfe25047-7e65-49e3-900a-a9329c651d40. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:06:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-1df45288-022e-4a30-9361-0a106af6f2f8 tempest-TestShelveInstance-1890351743 None] Terminate volume connection completed successfully. Jul 11 04:06:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-18decf9d-8ffa-4976-b7bd-86bc6bf6b0bb req-1df45288-022e-4a30-9361-0a106af6f2f8 tempest-TestShelveInstance-1890351743 None] Deleting attachment 3b56e739-89c2-43ba-a876-5f2fce030913. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=25,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "cinder-44d8504c-255a-401a-9b07-51cead58db08-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-44d8504c-255a-401a-9b07-51cead58db08-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "cinder-quobyte-44d8504c-255a-401a-9b07-51cead58db08" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-quobyte-44d8504c-255a-401a-9b07-51cead58db08" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aa0526-ba51-4d65-9f12-abdc90163b4f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:06:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:33 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 Jul 11 04:06:33 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:34 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08" returned: 0 in 0.765s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:34 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08 Jul 11 04:06:34 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:35 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-44d8504c-255a-401a-9b07-51cead58db08" returned: 0 in 0.625s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-quobyte-44d8504c-255a-401a-9b07-51cead58db08" released by "delete_volume" :: held 1.426s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Created reservations ['4ddbe91f-308f-4b46-a189-ba693f267cbc', 'c5b4b99e-b434-4677-a3de-adc73beed32a', 'b470a334-7ae7-4862-83af-19fc6ee797f1', '8a8d5937-442c-453b-bf02-07c6da93c50b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:35 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:06:35 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:35 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.620s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:06:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Deleted volume successfully. Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "cinder-1a24ac23-e59e-4a82-a1fb-4ead90fc378a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-1a24ac23-e59e-4a82-a1fb-4ead90fc378a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05ec4aeb-f51c-4410-921a-970124b9b004 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-44d8504c-255a-401a-9b07-51cead58db08-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "cinder-quobyte-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-quobyte-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616102d-d962-4393-bcb6-24554b9371e7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:06:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:36 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a Jul 11 04:06:36 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:36 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" returned: 0 in 0.723s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:36 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a Jul 11 04:06:36 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:37 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" returned: 0 in 0.632s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-quobyte-1a24ac23-e59e-4a82-a1fb-4ead90fc378a" released by "delete_volume" :: held 1.405s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Created reservations ['c47b73c8-4d97-4d26-8b10-450e31bf9da0', '8aa9e615-4056-416e-b028-468ad51c0beb', '9dc6b60b-e283-4fed-b98d-21129f31c9b6', 'a43faeab-30da-456a-8104-58c5881a2ebf'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:37 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:06:37 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:38 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:06:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Deleted volume successfully. Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1c1d181f-b0cf-4a7d-b93e-7a3472fda3ca tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-1a24ac23-e59e-4a82-a1fb-4ead90fc378a-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "cinder-9a85198b-8637-4eda-bab8-8d153723cdad-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-9a85198b-8637-4eda-bab8-8d153723cdad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "cinder-quobyte-9a85198b-8637-4eda-bab8-8d153723cdad" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-quobyte-9a85198b-8637-4eda-bab8-8d153723cdad" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c00982-dc39-4234-ba67-a2c4700dfd9c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:38 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad Jul 11 04:06:38 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:38 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:38 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad Jul 11 04:06:38 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:39 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9a85198b-8637-4eda-bab8-8d153723cdad" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-quobyte-9a85198b-8637-4eda-bab8-8d153723cdad" released by "delete_volume" :: held 1.399s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Created reservations ['fe8e6899-e89e-4f78-aeb7-d35af9ffd3a1', '87d42bf2-5754-4188-ac4c-6d530c8499b2', 'a9e47167-2501-4439-bd5f-90a22dcd2088', '71666a26-32fc-48cb-ada5-5cad4242311a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:06:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:06:39 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:06:39 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:06:40 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 11 04:06:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.644s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:06:40 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:06:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Deleted volume successfully. Jul 11 04:06:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-793d6f36-ae84-414d-975a-80d15eea5df9 tempest-AttachVolumeTestJSON-515024680 None] Lock "cinder-9a85198b-8637-4eda-bab8-8d153723cdad-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:06:49 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=38,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:06:50 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:07:14 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:07:14 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:07:14 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.659s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:07:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Flow 'volume_create_manager' (649d9c5f-bd59-4c68-9628-ad79caa781b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38825018-811b-490d-9c5e-877649c6ec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38825018-811b-490d-9c5e-877649c6ec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2055659049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eb2004-82ae-4170-a9ea-fa5fcfea6188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26883421d60646858c7b9bee87cfe4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:07:32Z,use_quota=True,user_id='29ab85536e3a4b39900f3b3ae52843ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f73706d-7e5d-4c11-8823-781b70f9fa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f73706d-7e5d-4c11-8823-781b70f9fa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a8fe9-1845-4113-a1b4-9270953ada46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a8fe9-1845-4113-a1b4-9270953ada46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35eb2004-82ae-4170-a9ea-fa5fcfea6188', 'volume_name': 'volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85288189-6dca-40bf-be4e-b1bb96161a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85288189-6dca-40bf-be4e-b1bb96161a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91089c6a-6e35-4e4d-998e-e08480ee8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:07:32 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Volume 35eb2004-82ae-4170-a9ea-fa5fcfea6188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188', 'volume_size': 1} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2055659049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35eb2004-82ae-4170-a9ea-fa5fcfea6188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26883421d60646858c7b9bee87cfe4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:07:32Z,use_quota=True,user_id='29ab85536e3a4b39900f3b3ae52843ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Creating volume 35eb2004-82ae-4170-a9ea-fa5fcfea6188 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:07:32 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:07:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:07:32 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 1073741824 Jul 11 04:07:32 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:07:33 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 1073741824" returned: 0 in 0.780s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:07:33 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 Jul 11 04:07:33 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:07:33 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188" returned: 0 in 0.637s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91089c6a-6e35-4e4d-998e-e08480ee8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3437822-0f2f-4ab2-9100-da6018b2dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:07:33 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Volume volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 (35eb2004-82ae-4170-a9ea-fa5fcfea6188): created successfully Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3437822-0f2f-4ab2-9100-da6018b2dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:07:33 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Flow 'volume_create_manager' (649d9c5f-bd59-4c68-9628-ad79caa781b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:07:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fc94e50e-c901-4294-a9c3-1d8923c8e1d5 tempest-AttachVolumeNegativeTest-443475276 None] Created volume successfully. Jul 11 04:07:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:07:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:07:37 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd474f-e5e2-4d69-a3a8-4fdb4dad8f36]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:07:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:07:37 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 Jul 11 04:07:37 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:07:38 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 11 04:07:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188" returned: 0 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:07:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:07:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f339dafc-8550-4815-85ad-ffa6939aed25', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:07:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-7eaa83de-5e16-4d04-be68-e99dd3fa580c req-e0a5f2ce-aca9-47c1-abf9-d2326c43bc1b tempest-AttachVolumeNegativeTest-443475276 None] attachment_update completed successfully. Jul 11 04:07:48 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:07:48 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:08:14 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:08:14 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:08:14 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.628s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:08:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:08:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-9ac74d97-3a98-44ce-b24f-7077ff1678e7 req-216c89f0-db31-4ed3-b52a-1d59f8ce0c8f tempest-AttachVolumeNegativeTest-443475276 None] Terminate volume connection completed successfully. Jul 11 04:08:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-9ac74d97-3a98-44ce-b24f-7077ff1678e7 req-216c89f0-db31-4ed3-b52a-1d59f8ce0c8f tempest-AttachVolumeNegativeTest-443475276 None] Deleting attachment f339dafc-8550-4815-85ad-ffa6939aed25. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:08:40 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:08:40 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:14 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:09:14 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:14 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.641s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:09:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Flow 'volume_create_manager' (8af4f12e-e702-4fdd-8423-e5e4fb1b3d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6cc0ba-d98d-46c9-a59b-76731687edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6cc0ba-d98d-46c9-a59b-76731687edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559392714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb6281f-6977-4645-a5d6-14e1cbf3bf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26883421d60646858c7b9bee87cfe4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:19Z,use_quota=True,user_id='29ab85536e3a4b39900f3b3ae52843ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b96ec-581f-4fa6-875a-88430d50d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b96ec-581f-4fa6-875a-88430d50d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fe4a3-5440-4e8d-9733-8b2c98835f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fe4a3-5440-4e8d-9733-8b2c98835f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb6281f-6977-4645-a5d6-14e1cbf3bf92', 'volume_name': 'volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88459ce-c17a-4456-8bf4-81f99282c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88459ce-c17a-4456-8bf4-81f99282c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2037431c-8ba8-42f7-8753-44851a7d18fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Volume 4cb6281f-6977-4645-a5d6-14e1cbf3bf92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92', 'volume_size': 1} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559392714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb6281f-6977-4645-a5d6-14e1cbf3bf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26883421d60646858c7b9bee87cfe4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:19Z,use_quota=True,user_id='29ab85536e3a4b39900f3b3ae52843ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Creating volume 4cb6281f-6977-4645-a5d6-14e1cbf3bf92 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:18 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:18 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 1073741824 Jul 11 04:09:18 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:19 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 1073741824" returned: 0 in 0.799s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:19 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 Jul 11 04:09:19 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:20 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2037431c-8ba8-42f7-8753-44851a7d18fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c387e97-2c71-4ed0-be31-853617f295a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Volume volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 (4cb6281f-6977-4645-a5d6-14e1cbf3bf92): created successfully Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c387e97-2c71-4ed0-be31-853617f295a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Flow 'volume_create_manager' (8af4f12e-e702-4fdd-8423-e5e4fb1b3d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8522801a-f154-4b68-8542-c58b73aa7141 tempest-AttachVolumeNegativeTest-443475276 None] Created volume successfully. Jul 11 04:09:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda63546-277b-4915-b0d8-790b7530c9ac]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:09:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:23 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 Jul 11 04:09:23 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:24 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9524ad03-92d9-42ea-a400-d95953b4e636', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:09:24 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-78981f91-3101-4734-b716-78ce44bb6308 req-0f4f54bb-f69c-4734-9393-ee4eab0f0317 tempest-AttachVolumeNegativeTest-443475276 None] attachment_update completed successfully. Jul 11 04:09:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Acquiring lock "cinder-85f973fe-c250-40eb-83b5-ce89310ae399-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Lock "cinder-85f973fe-c250-40eb-83b5-ce89310ae399-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Acquiring lock "cinder-quobyte-85f973fe-c250-40eb-83b5-ce89310ae399" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Lock "cinder-quobyte-85f973fe-c250-40eb-83b5-ce89310ae399" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:26 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff49ad-e0a2-4701-9091-c701d61a806a]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:09:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:26 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:09:26 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:27 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 0.818s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:27 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:09:27 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:28 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 1 in 0.865s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:09:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:28 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399 Jul 11 04:09:28 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:29 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85f973fe-c250-40eb-83b5-ce89310ae399" returned: 0 in 0.774s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Lock "cinder-quobyte-85f973fe-c250-40eb-83b5-ce89310ae399" released by "delete_volume" :: held 2.520s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG cinder.quota [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Created reservations ['73cbe493-f39f-47ab-be38-04173fcb0ebb', '1e338caf-d7d1-4e93-a879-cd07813dc940', 'c7d3ff14-e48d-4cd9-a369-c0b55d32fff3', '2ca85f30-4e5d-493a-8f59-802953e364b9'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:29 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:09:29 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:30 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.697s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:30 devstack cinder-volume[87437]: DEBUG cinder.manager [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:09:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Deleted volume successfully. Jul 11 04:09:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [req-ccc8193a-2723-4b18-837c-8b95f03910dd req-1cdcfb12-8ad4-4644-8415-6393c2e8f490 tempest-TestShelveInstance-1890351743 None] Lock "cinder-85f973fe-c250-40eb-83b5-ce89310ae399-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-acce5853-3ccf-411b-995c-24553270caf6 req-656aac6b-e86d-4fc8-96be-09290f20f36e tempest-AttachVolumeNegativeTest-443475276 None] Terminate volume connection completed successfully. Jul 11 04:09:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-acce5853-3ccf-411b-995c-24553270caf6 req-656aac6b-e86d-4fc8-96be-09290f20f36e tempest-AttachVolumeNegativeTest-443475276 None] Deleting attachment 9524ad03-92d9-42ea-a400-d95953b4e636. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (0f02eb3f-2bb7-49a0-b495-5d2d8814603a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec28fd1-9f41-4432-93ed-ac18c8ec248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec28fd1-9f41-4432-93ed-ac18c8ec248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969064295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcc38fa-c21f-440d-8012-2a87e7718200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:40Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c315ae7-29d2-443f-bd30-901d33405869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c315ae7-29d2-443f-bd30-901d33405869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5f3178-aa4a-4f92-bd37-45723a0b2a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5f3178-aa4a-4f92-bd37-45723a0b2a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcc38fa-c21f-440d-8012-2a87e7718200', 'volume_name': 'volume-fdcc38fa-c21f-440d-8012-2a87e7718200', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7409a8c-53ed-40f4-bb9e-0a82d234b27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7409a8c-53ed-40f4-bb9e-0a82d234b27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9595aff5-69a8-4a22-b98c-f236b3153897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:39 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume fdcc38fa-c21f-440d-8012-2a87e7718200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcc38fa-c21f-440d-8012-2a87e7718200', 'volume_size': 1} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969064295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcc38fa-c21f-440d-8012-2a87e7718200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:40Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Creating volume fdcc38fa-c21f-440d-8012-2a87e7718200 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:39 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:39 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 1073741824 Jul 11 04:09:39 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:40 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 1073741824" returned: 0 in 0.905s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:40 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 Jul 11 04:09:40 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:41 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200" returned: 0 in 0.689s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9595aff5-69a8-4a22-b98c-f236b3153897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcc38fa-c21f-440d-8012-2a87e7718200', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c842a76-c8d1-4106-9dbe-363a6b2f7e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:41 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume volume-fdcc38fa-c21f-440d-8012-2a87e7718200 (fdcc38fa-c21f-440d-8012-2a87e7718200): created successfully Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c842a76-c8d1-4106-9dbe-363a6b2f7e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (0f02eb3f-2bb7-49a0-b495-5d2d8814603a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d8495abe-e7fa-47c7-8e6d-e2065989917a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created volume successfully. Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (b8f71bcc-34df-4c90-97e0-20d80c3a64da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba327da-ce40-4461-9563-d9e1854f6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba327da-ce40-4461-9563-d9e1854f6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952812378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e81c92-5e6f-4c80-9ea5-4f775ad13ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:42Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb569ab7-0949-4878-bdf1-cd8be2628d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb569ab7-0949-4878-bdf1-cd8be2628d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7b24c0-eaff-4882-a3a9-101ad9590b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7b24c0-eaff-4882-a3a9-101ad9590b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e81c92-5e6f-4c80-9ea5-4f775ad13ccc', 'volume_name': 'volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e57ff1-ff3b-4776-a099-badcbd90dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e57ff1-ff3b-4776-a099-badcbd90dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1247d61e-cc6d-4a17-904a-ef6b454aa1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume 19e81c92-5e6f-4c80-9ea5-4f775ad13ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc', 'volume_size': 1} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952812378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e81c92-5e6f-4c80-9ea5-4f775ad13ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:42Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Creating volume 19e81c92-5e6f-4c80-9ea5-4f775ad13ccc {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:42 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:42 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc 1073741824 Jul 11 04:09:42 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (b823d343-ba5b-419a-8dc9-4fda3dc5835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b40af70-4d35-481e-8d39-850a26232067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b40af70-4d35-481e-8d39-850a26232067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021136992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801d9a41-3ae2-4a52-9196-7cf0555cd317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:43Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44507a0a-ea5a-4695-acc6-de54ea96df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44507a0a-ea5a-4695-acc6-de54ea96df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae11349-3057-45c5-9d70-b3575528363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae11349-3057-45c5-9d70-b3575528363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801d9a41-3ae2-4a52-9196-7cf0555cd317', 'volume_name': 'volume-801d9a41-3ae2-4a52-9196-7cf0555cd317', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fabf95e-1e48-4a4b-94cf-a30f22158698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fabf95e-1e48-4a4b-94cf-a30f22158698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af321f4-efea-43b4-8e6c-c96f004cff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:42 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume 801d9a41-3ae2-4a52-9196-7cf0555cd317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801d9a41-3ae2-4a52-9196-7cf0555cd317', 'volume_size': 1} Jul 11 04:09:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (7d716b4b-5000-4da2-82ba-cb513c4bc52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5fca07-d1ee-4f87-ad83-d20615352e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5fca07-d1ee-4f87-ad83-d20615352e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435412612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3186eea4-3b81-4600-8ee9-db3250c25a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:43Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5ec9e5-bce3-4356-bb74-f45bcf93f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5ec9e5-bce3-4356-bb74-f45bcf93f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9995ea61-b2fd-4b64-85e8-d006d79c168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9995ea61-b2fd-4b64-85e8-d006d79c168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3186eea4-3b81-4600-8ee9-db3250c25a94', 'volume_name': 'volume-3186eea4-3b81-4600-8ee9-db3250c25a94', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b9680c-e650-4fd4-bcc3-d536a19a1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b9680c-e650-4fd4-bcc3-d536a19a1791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e496c46-6bb7-41e8-b283-a680966df656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume 3186eea4-3b81-4600-8ee9-db3250c25a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3186eea4-3b81-4600-8ee9-db3250c25a94', 'volume_size': 1} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:43 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc 1073741824" returned: 0 in 1.125s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (8f9799fc-d7d7-434e-934f-3606520e7cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098d57fe-897b-452e-88fe-52a61b8d44ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098d57fe-897b-452e-88fe-52a61b8d44ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004766721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee186a6-f1f2-43f9-8f3e-36e7ae80f047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:43Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d2f56-b7dc-436e-8983-ed2da86f546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d2f56-b7dc-436e-8983-ed2da86f546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c475c7-02ba-48cc-a79d-ff4ae2cb5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c475c7-02ba-48cc-a79d-ff4ae2cb5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee186a6-f1f2-43f9-8f3e-36e7ae80f047', 'volume_name': 'volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5250284-5176-429e-879e-9b3432049917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5250284-5176-429e-879e-9b3432049917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4be8287-0d6c-4d5d-badd-aeab056573bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume eee186a6-f1f2-43f9-8f3e-36e7ae80f047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047', 'volume_size': 1} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:43 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc Jul 11 04:09:43 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (9299627f-67b6-4351-bc46-b93c6db9e1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13814c5-2b2e-4ebc-8fa3-1af9b8efe0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13814c5-2b2e-4ebc-8fa3-1af9b8efe0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102218838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0719123-f4f2-4b22-a983-0865eb3aa22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:44Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b66992-cf11-4be4-a28d-df1ecbc5c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b66992-cf11-4be4-a28d-df1ecbc5c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099e8810-5cd2-4e70-873e-8296666314dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099e8810-5cd2-4e70-873e-8296666314dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0719123-f4f2-4b22-a983-0865eb3aa22c', 'volume_name': 'volume-c0719123-f4f2-4b22-a983-0865eb3aa22c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798ebc7b-81db-4475-8901-bd996501894d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798ebc7b-81db-4475-8901-bd996501894d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a508f7b-2d49-49a5-a4e0-1f000153e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:44 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume c0719123-f4f2-4b22-a983-0865eb3aa22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0719123-f4f2-4b22-a983-0865eb3aa22c', 'volume_size': 1} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:44 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021136992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801d9a41-3ae2-4a52-9196-7cf0555cd317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:43Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Creating volume 801d9a41-3ae2-4a52-9196-7cf0555cd317 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:44 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1247d61e-cc6d-4a17-904a-ef6b454aa1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3552a93c-7a34-424b-a57a-00bcc1df7c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:44 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 1073741824 Jul 11 04:09:44 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:44 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc (19e81c92-5e6f-4c80-9ea5-4f775ad13ccc): created successfully Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3552a93c-7a34-424b-a57a-00bcc1df7c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (b8f71bcc-34df-4c90-97e0-20d80c3a64da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5dfc6f84-2adf-4afe-a2aa-6479a2a5b22a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created volume successfully. Jul 11 04:09:45 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 1073741824" returned: 0 in 0.918s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:45 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 Jul 11 04:09:45 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:45 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317" returned: 0 in 0.648s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435412612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3186eea4-3b81-4600-8ee9-db3250c25a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:43Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Creating volume 3186eea4-3b81-4600-8ee9-db3250c25a94 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:45 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:46 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 1073741824 Jul 11 04:09:46 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af321f4-efea-43b4-8e6c-c96f004cff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801d9a41-3ae2-4a52-9196-7cf0555cd317', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7aed85-591d-4551-9e66-344a646993db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:46 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 (801d9a41-3ae2-4a52-9196-7cf0555cd317): created successfully Jul 11 04:09:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7aed85-591d-4551-9e66-344a646993db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (b823d343-ba5b-419a-8dc9-4fda3dc5835e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5dabc4e8-653b-419a-a483-fc504e02d071 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created volume successfully. Jul 11 04:09:46 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 1073741824" returned: 0 in 0.807s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:46 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 Jul 11 04:09:46 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:47 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.856s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1004766721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee186a6-f1f2-43f9-8f3e-36e7ae80f047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:43Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Creating volume eee186a6-f1f2-43f9-8f3e-36e7ae80f047 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:47 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:47 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 1073741824 Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e496c46-6bb7-41e8-b283-a680966df656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3186eea4-3b81-4600-8ee9-db3250c25a94', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:47 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fec15a-e37d-4f00-81ae-a607d8cff55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:47 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume volume-3186eea4-3b81-4600-8ee9-db3250c25a94 (3186eea4-3b81-4600-8ee9-db3250c25a94): created successfully Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fec15a-e37d-4f00-81ae-a607d8cff55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (7d716b4b-5000-4da2-82ba-cb513c4bc52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-afef0439-dbad-4b91-a5f4-8de85fde6447 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created volume successfully. Jul 11 04:09:48 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 1073741824" returned: 0 in 0.850s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:48 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 Jul 11 04:09:48 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:49 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047" returned: 0 in 0.664s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.072s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-102218838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0719123-f4f2-4b22-a983-0865eb3aa22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357bb70cfe584417a0cd051adee8ef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:09:44Z,use_quota=True,user_id='8f51c222c3904cf88c5710e24decf5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Creating volume c0719123-f4f2-4b22-a983-0865eb3aa22c {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:09:49 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4be8287-0d6c-4d5d-badd-aeab056573bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:49 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c 1073741824 Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffc5b59-b75a-4743-bdcc-8383ac875411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:49 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:49 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 (eee186a6-f1f2-43f9-8f3e-36e7ae80f047): created successfully Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffc5b59-b75a-4743-bdcc-8383ac875411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (8f9799fc-d7d7-434e-934f-3606520e7cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0aa50c08-280d-4daa-a6d7-d68a859f9fc7 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created volume successfully. Jul 11 04:09:50 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c 1073741824" returned: 0 in 1.048s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:50 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c Jul 11 04:09:50 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:50 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c" returned: 0 in 0.677s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a508f7b-2d49-49a5-a4e0-1f000153e134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0719123-f4f2-4b22-a983-0865eb3aa22c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9eb71c5-1452-4d45-895e-586a8146b141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:09:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Volume volume-c0719123-f4f2-4b22-a983-0865eb3aa22c (c0719123-f4f2-4b22-a983-0865eb3aa22c): created successfully Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9eb71c5-1452-4d45-895e-586a8146b141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:09:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Flow 'volume_create_manager' (9299627f-67b6-4351-bc46-b93c6db9e1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:09:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fc50088d-503d-462a-95f3-a31609595f44 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created volume successfully. Jul 11 04:09:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-c0719123-f4f2-4b22-a983-0865eb3aa22c-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-c0719123-f4f2-4b22-a983-0865eb3aa22c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-quobyte-c0719123-f4f2-4b22-a983-0865eb3aa22c" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-c0719123-f4f2-4b22-a983-0865eb3aa22c" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:51 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec017b92-1f22-4bf2-a8f6-64b204ebdcfc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:09:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:51 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c Jul 11 04:09:51 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:52 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c" returned: 0 in 0.816s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:52 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c Jul 11 04:09:52 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:53 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c0719123-f4f2-4b22-a983-0865eb3aa22c" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-c0719123-f4f2-4b22-a983-0865eb3aa22c" released by "delete_volume" :: held 1.474s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created reservations ['054daa63-6239-4f6f-8d74-e4093f002f9f', 'f1d290e0-57ab-4e65-a5fb-6c8092d21e17', '77ac4508-fee9-4c51-a1f9-4227d0b98c5e', '8f5e384f-4dbe-41ad-9ba9-bed112799ff3'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:53 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:09:53 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-eee186a6-f1f2-43f9-8f3e-36e7ae80f047-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-eee186a6-f1f2-43f9-8f3e-36e7ae80f047-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-quobyte-eee186a6-f1f2-43f9-8f3e-36e7ae80f047" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-eee186a6-f1f2-43f9-8f3e-36e7ae80f047" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a3120-1bcc-4fa0-851d-d62b6faf9669]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:53 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:53 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:09:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Deleted volume successfully. Jul 11 04:09:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-138296c0-03a9-40f3-aee5-f63f8fe73e8a tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-c0719123-f4f2-4b22-a983-0865eb3aa22c-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:54 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 Jul 11 04:09:54 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:54 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047" returned: 0 in 0.992s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:54 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047 Jul 11 04:09:54 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:55 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eee186a6-f1f2-43f9-8f3e-36e7ae80f047" returned: 0 in 0.630s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-eee186a6-f1f2-43f9-8f3e-36e7ae80f047" released by "delete_volume" :: held 1.660s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created reservations ['ea9a2500-0a3e-48be-a9f7-d058b5141887', 'd4948021-84b9-43d4-b08d-141bb2e35156', '3f2c0593-2ff7-4420-9f55-f82bf6bd87dc', 'b1327314-b812-4ba7-92b3-770d0223891d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:55 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:09:55 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-3186eea4-3b81-4600-8ee9-db3250c25a94-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-3186eea4-3b81-4600-8ee9-db3250c25a94-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-quobyte-3186eea4-3b81-4600-8ee9-db3250c25a94" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-3186eea4-3b81-4600-8ee9-db3250c25a94" acquired by "delete_volume" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e503c590-9d42-44dd-b86b-689168824196]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:56 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 Jul 11 04:09:56 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:56 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.785s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:09:56 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Deleted volume successfully. Jul 11 04:09:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d735e995-9cd9-443f-a6d2-1c4d495de053 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-eee186a6-f1f2-43f9-8f3e-36e7ae80f047-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:57 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94" returned: 0 in 0.812s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:57 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94 Jul 11 04:09:57 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:57 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3186eea4-3b81-4600-8ee9-db3250c25a94" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-3186eea4-3b81-4600-8ee9-db3250c25a94" released by "delete_volume" :: held 1.534s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created reservations ['328315e9-6e29-4662-a186-bf5c4fdbb820', '18419896-b092-4118-9396-296cffb09477', '6c0e53db-9090-459b-adb4-5b6d824d76e8', 'd52e268f-802b-48e1-955e-5dcaf79c3c1f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:09:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:57 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:09:57 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-801d9a41-3ae2-4a52-9196-7cf0555cd317-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-801d9a41-3ae2-4a52-9196-7cf0555cd317-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-quobyte-801d9a41-3ae2-4a52-9196-7cf0555cd317" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-801d9a41-3ae2-4a52-9196-7cf0555cd317" acquired by "delete_volume" :: waited 0.039s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a14795a-796c-4dd1-9882-351bd71b60fa]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:58 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.698s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:09:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Deleted volume successfully. Jul 11 04:09:58 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 Jul 11 04:09:58 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:09:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fb6b71d5-7ace-4559-a8a3-7a147b3d60ca tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-3186eea4-3b81-4600-8ee9-db3250c25a94-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:09:59 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 11 04:09:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317" returned: 0 in 0.825s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:09:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:09:59 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317 Jul 11 04:09:59 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:00 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-801d9a41-3ae2-4a52-9196-7cf0555cd317" returned: 0 in 0.689s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-801d9a41-3ae2-4a52-9196-7cf0555cd317" released by "delete_volume" :: held 1.577s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created reservations ['33de29a6-fb31-4bfa-ae2d-19e51f36dc11', 'c69308b5-6ae3-41e1-be67-1d8fb97f8f63', '78e8a163-909b-4887-8a7f-a970565cf98c', '8e29bd69-0bcd-497e-adda-95926cf8dbcd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:00 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:00 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-quobyte-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf4d6eb-0b2e-4691-a50d-cc2988823718]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:00 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:00 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Deleted volume successfully. Jul 11 04:10:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fae34444-0c89-452b-baf2-ed870f43041c tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-801d9a41-3ae2-4a52-9196-7cf0555cd317-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:00 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc Jul 11 04:10:00 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:01 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc" returned: 0 in 0.781s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:01 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc Jul 11 04:10:01 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:02 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc" returned: 0 in 0.611s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc" released by "delete_volume" :: held 1.456s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created reservations ['1c77d216-a0a3-424d-9ef0-5e63ae03325a', 'dcec9a4e-f073-4661-bd1a-f28efa73fd57', 'd5f0b394-c0bc-43c8-b944-a0cbc30cc155', '56f40c35-c00b-4dfb-bc2e-0fb740e835bd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:02 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:02 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-fdcc38fa-c21f-440d-8012-2a87e7718200-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-fdcc38fa-c21f-440d-8012-2a87e7718200-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:02 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "cinder-quobyte-fdcc38fa-c21f-440d-8012-2a87e7718200" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.637s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:02 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Deleted volume successfully. Jul 11 04:10:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-fdcc38fa-c21f-440d-8012-2a87e7718200" acquired by "delete_volume" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90657b41-03cb-42f7-8652-17a4c294358d tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-19e81c92-5e6f-4c80-9ea5-4f775ad13ccc-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0edf29-602c-43a6-8279-68c8445281b3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:03 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 Jul 11 04:10:03 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:03 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200" returned: 0 in 0.760s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:03 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200 Jul 11 04:10:03 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:04 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fdcc38fa-c21f-440d-8012-2a87e7718200" returned: 0 in 0.606s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-quobyte-fdcc38fa-c21f-440d-8012-2a87e7718200" released by "delete_volume" :: held 1.409s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Created reservations ['691c292a-8d22-4288-8b5d-73e08ad18dd5', '18f38cbb-e1ba-467c-be75-d39c21a94ed5', '8a7ee2cc-eaba-4245-a608-194df955eaf6', 'b63aca5b-cdf9-4b7b-8578-124401b80669'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:04 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:04 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:05 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.640s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:05 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Deleted volume successfully. Jul 11 04:10:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb5bd431-43ca-43be-9703-aeb2e0e152a3 tempest-CreateVolumesFromSourceVolumeTest-227788309 None] Lock "cinder-fdcc38fa-c21f-440d-8012-2a87e7718200-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Flow 'volume_create_manager' (335af36a-d8f5-461d-953a-cf1dfb5da546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b418b6c-fc59-42ea-86af-d4145cf43426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b418b6c-fc59-42ea-86af-d4145cf43426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cebad7-d350-4828-a4c6-787605273228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b4432b9dd74b398212ca8058a0de63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:10:10Z,use_quota=True,user_id='82e2823b38674841857616b885bab54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff9a5e4-6b71-4749-a0a4-a6c50be18473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff9a5e4-6b71-4749-a0a4-a6c50be18473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814a9d06-e78a-47ff-9da5-f50a8546dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814a9d06-e78a-47ff-9da5-f50a8546dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4cebad7-d350-4828-a4c6-787605273228', 'volume_name': 'volume-e4cebad7-d350-4828-a4c6-787605273228', 'volume_size': 1, 'image_id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/235bc5c9-06bb-4424-9bed-2ad672b6501e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '825a11d4b0bf1f12e1704e4f44ecdd5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2b4432b9dd74b398212ca8058a0de63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23a8801bb9068f46f94ccf56dc8a92a3cb7c0e4b7a3e0c2553e411417b858c4f370bf79ba71ec68dcf6b99684133bd437476f6b43bc16ffab664b14bcb36176d', 'id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'created_at': datetime.datetime(2026, 7, 11, 2, 10, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 10, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/235bc5c9-06bb-4424-9bed-2ad672b6501e/file', 'properties': {}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6913c2-a9fe-4d86-9fd1-ecf7cff8aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6913c2-a9fe-4d86-9fd1-ecf7cff8aa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e240d4-c213-4ff6-adf1-aea6bbf42f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Volume e4cebad7-d350-4828-a4c6-787605273228: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4cebad7-d350-4828-a4c6-787605273228', 'volume_size': 1, 'image_id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/235bc5c9-06bb-4424-9bed-2ad672b6501e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '825a11d4b0bf1f12e1704e4f44ecdd5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2b4432b9dd74b398212ca8058a0de63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23a8801bb9068f46f94ccf56dc8a92a3cb7c0e4b7a3e0c2553e411417b858c4f370bf79ba71ec68dcf6b99684133bd437476f6b43bc16ffab664b14bcb36176d', 'id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'created_at': datetime.datetime(2026, 7, 11, 2, 10, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 10, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/235bc5c9-06bb-4424-9bed-2ad672b6501e/file', 'properties': {}}, 'image_service': } Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Trying to clone e4cebad7-d350-4828-a4c6-787605273228 from image 235bc5c9-06bb-4424-9bed-2ad672b6501e at location (None, [{'url': 'file:///opt/stack/data/glance/images/235bc5c9-06bb-4424-9bed-2ad672b6501e', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:10:10 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1530f-7ac3-4828-9cfd-afb222b1f253]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:10 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD Jul 11 04:10:10 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:11 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:11 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD Jul 11 04:10:11 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:12 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD" returned: 1 in 0.690s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Temporary image 235bc5c9-06bb-4424-9bed-2ad672b6501e is fetched for user 82e2823b38674841857616b885bab54d. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=60,cinder:UPDATE=83,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=76,cinder:SELECT=56,cinder:INSERT=19,cinder:DELETE=9 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba242aa-33ac-4a77-8fbb-0ea18ae8398e]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:12 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD Jul 11 04:10:12 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:12 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:13 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD Jul 11 04:10:13 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:13 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD" returned: 1 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cebad7-d350-4828-a4c6-787605273228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2b4432b9dd74b398212ca8058a0de63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:10:10Z,use_quota=True,user_id='82e2823b38674841857616b885bab54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Creating volume e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:10:13 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:10:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:13 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 1073741824 Jul 11 04:10:13 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:14 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:14 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:14 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 1073741824" returned: 0 in 0.925s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:14 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:14 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:14 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.726s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:10:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:10:15 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 0 in 0.622s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:10:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:15 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Attempting download of 235bc5c9-06bb-4424-9bed-2ad672b6501e ((None, [{'url': 'file:///opt/stack/data/glance/images/235bc5c9-06bb-4424-9bed-2ad672b6501e', 'metadata': {}}])) to volume e4cebad7-d350-4828-a4c6-787605273228. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:10:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3379d-003f-48de-b96c-44276188c5da]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:15 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i Jul 11 04:10:15 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:16 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i" returned: 0 in 0.699s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:16 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i Jul 11 04:10:16 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:16 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i" returned: 1 in 0.711s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_235bc5c9-06bb-4424-9bed-2ad672b6501e_ompzu7_i' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:10:16 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aada5b4-a7f1-4ad9-84e9-241af32d5bfa]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:16 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD Jul 11 04:10:16 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:17 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:17 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD Jul 11 04:10:17 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:18 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:10:18 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] 235bc5c9-06bb-4424-9bed-2ad672b6501e was raw, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:10:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:18 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:18 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:19 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 0 in 0.762s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:19 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_235bc5c9-06bb-4424-9bed-2ad672b6501e_q2lwshmkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:10:19 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:10:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:19 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 1G Jul 11 04:10:19 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:19 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 1G" returned: 0 in 0.648s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6111d9-fdc2-4b51-809a-f900750c0792]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:19 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:19 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Flow 'volume_create_manager' (248b9467-9b3c-43f1-be53-45d3dcc861b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e239a89-ba13-47e1-8801-5a44475d3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e239a89-ba13-47e1-8801-5a44475d3de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1290906031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1911f31e-c348-4fba-83ed-b5b134e224e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26883421d60646858c7b9bee87cfe4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:10:20Z,use_quota=True,user_id='29ab85536e3a4b39900f3b3ae52843ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45955002-3940-4691-afa8-7af944270e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45955002-3940-4691-afa8-7af944270e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d5aae9-064d-4adc-ae46-5e6d35806ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01d5aae9-064d-4adc-ae46-5e6d35806ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1911f31e-c348-4fba-83ed-b5b134e224e2', 'volume_name': 'volume-1911f31e-c348-4fba-83ed-b5b134e224e2', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5e5487-6df2-4180-bfa9-29b1571930d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5e5487-6df2-4180-bfa9-29b1571930d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51959c4-6012-459f-8931-1535d6ff2d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Volume 1911f31e-c348-4fba-83ed-b5b134e224e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1911f31e-c348-4fba-83ed-b5b134e224e2', 'volume_size': 1} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1290906031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1911f31e-c348-4fba-83ed-b5b134e224e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26883421d60646858c7b9bee87cfe4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:10:20Z,use_quota=True,user_id='29ab85536e3a4b39900f3b3ae52843ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Creating volume 1911f31e-c348-4fba-83ed-b5b134e224e2 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:10:20 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:20 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 1073741824 Jul 11 04:10:20 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:20 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 0 in 0.822s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:20 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:20 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:21 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 1073741824" returned: 0 in 0.889s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:21 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 Jul 11 04:10:21 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:21 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 1 in 0.787s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Downloaded image 235bc5c9-06bb-4424-9bed-2ad672b6501e ((None, [{'url': 'file:///opt/stack/data/glance/images/235bc5c9-06bb-4424-9bed-2ad672b6501e', 'metadata': {}}])) to volume e4cebad7-d350-4828-a4c6-787605273228 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Temporary image 235bc5c9-06bb-4424-9bed-2ad672b6501e for user 82e2823b38674841857616b885bab54d is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Marking volume e4cebad7-d350-4828-a4c6-787605273228 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Copying metadata from image 235bc5c9-06bb-4424-9bed-2ad672b6501e to e4cebad7-d350-4828-a4c6-787605273228. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Creating volume glance metadata for volume e4cebad7-d350-4828-a4c6-787605273228 backed by image 235bc5c9-06bb-4424-9bed-2ad672b6501e with: {'image_id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '825a11d4b0bf1f12e1704e4f44ecdd5e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e240d4-c213-4ff6-adf1-aea6bbf42f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cebad7-d350-4828-a4c6-787605273228', 'volume_size': 1, 'image_id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/235bc5c9-06bb-4424-9bed-2ad672b6501e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '825a11d4b0bf1f12e1704e4f44ecdd5e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2b4432b9dd74b398212ca8058a0de63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '23a8801bb9068f46f94ccf56dc8a92a3cb7c0e4b7a3e0c2553e411417b858c4f370bf79ba71ec68dcf6b99684133bd437476f6b43bc16ffab664b14bcb36176d', 'id': '235bc5c9-06bb-4424-9bed-2ad672b6501e', 'created_at': datetime.datetime(2026, 7, 11, 2, 10, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 10, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/235bc5c9-06bb-4424-9bed-2ad672b6501e/file', 'properties': {}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c8e4aa-4009-492d-866b-a50fdbb3ee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:21 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Volume volume-e4cebad7-d350-4828-a4c6-787605273228 (e4cebad7-d350-4828-a4c6-787605273228): created successfully Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c8e4aa-4009-492d-866b-a50fdbb3ee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Flow 'volume_create_manager' (335af36a-d8f5-461d-953a-cf1dfb5da546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:10:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1dedbb4e-de31-4016-9311-96b43e4c41fc tempest-VolumeImageDependencyTests-1617417306 None] Created volume successfully. Jul 11 04:10:21 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2" returned: 0 in 0.652s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51959c4-6012-459f-8931-1535d6ff2d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1911f31e-c348-4fba-83ed-b5b134e224e2', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6054818-236e-4fce-b884-0aa8bb1c8df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:21 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Volume volume-1911f31e-c348-4fba-83ed-b5b134e224e2 (1911f31e-c348-4fba-83ed-b5b134e224e2): created successfully Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6054818-236e-4fce-b884-0aa8bb1c8df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Flow 'volume_create_manager' (248b9467-9b3c-43f1-be53-45d3dcc861b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:10:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6586051b-99aa-4e80-84ae-f88fe830d456 tempest-AttachVolumeNegativeTest-443475276 None] Created volume successfully. Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Acquiring lock "cinder-e4cebad7-d350-4828-a4c6-787605273228-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Lock "cinder-e4cebad7-d350-4828-a4c6-787605273228-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Acquiring lock "cinder-quobyte-e4cebad7-d350-4828-a4c6-787605273228" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Lock "cinder-quobyte-e4cebad7-d350-4828-a4c6-787605273228" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd28daf9-9098-410c-b16b-7121260aed1c]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:22 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:22 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:22 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:23 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:23 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:23 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 1 in 0.767s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:10:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:23 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228 Jul 11 04:10:23 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:24 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e4cebad7-d350-4828-a4c6-787605273228" returned: 0 in 0.765s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Lock "cinder-quobyte-e4cebad7-d350-4828-a4c6-787605273228" released by "delete_volume" :: held 2.357s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Created reservations ['aba38d85-ae56-4a40-b576-060af2637204', '284f9018-cda6-4bf0-8f79-26c99cb3f851', '99c3eb9c-7916-4e74-b911-52a31231c473', '7cb2305e-866b-4d2a-9d64-8a947f4cfcc1'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:24 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:24 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[419676b1-f0a4-4ce4-9b5d-82620b308cb5]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:25 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.705s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:25 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Deleted volume successfully. Jul 11 04:10:25 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-aea82e93-d578-4f8e-88d2-ba095afb7411 tempest-VolumeImageDependencyTests-1617417306 None] Lock "cinder-e4cebad7-d350-4828-a4c6-787605273228-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:25 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 Jul 11 04:10:25 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:26 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2" returned: 0 in 0.822s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-1911f31e-c348-4fba-83ed-b5b134e224e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b729aa38-0b8b-46f2-b454-ca36f85f6986', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:10:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-4061a8c5-94b5-4412-ae57-ba57436f6e0d req-23186954-1d15-4f1f-8d5d-668fdfafc5fb tempest-AttachVolumeNegativeTest-443475276 None] attachment_update completed successfully. Jul 11 04:10:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-72442199-bbb5-4a5a-bbfd-980cde94efa5 req-15714b62-5664-4f31-baf6-078a4c7ec07d tempest-AttachVolumeNegativeTest-443475276 None] Terminate volume connection completed successfully. Jul 11 04:10:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-72442199-bbb5-4a5a-bbfd-980cde94efa5 req-15714b62-5664-4f31-baf6-078a4c7ec07d tempest-AttachVolumeNegativeTest-443475276 None] Deleting attachment b729aa38-0b8b-46f2-b454-ca36f85f6986. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:INSERT=11,cinder:SELECT=19,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "cinder-1911f31e-c348-4fba-83ed-b5b134e224e2-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-1911f31e-c348-4fba-83ed-b5b134e224e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "cinder-quobyte-1911f31e-c348-4fba-83ed-b5b134e224e2" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-quobyte-1911f31e-c348-4fba-83ed-b5b134e224e2" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[297016d6-7ccc-48c4-8b27-94ee2a56f570]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:42 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 Jul 11 04:10:42 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:43 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2" returned: 0 in 0.864s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:43 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2 Jul 11 04:10:43 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:43 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1911f31e-c348-4fba-83ed-b5b134e224e2" returned: 0 in 0.684s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-quobyte-1911f31e-c348-4fba-83ed-b5b134e224e2" released by "delete_volume" :: held 1.593s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Created reservations ['d9151071-f8d3-44a6-b5a5-2df3a3023dff', '77553df5-51d6-47c6-b751-a5e8d08f8431', 'e4c6c551-ce19-4862-830c-003791aea392', '0a1ec44a-83bf-4101-87db-50c2ff41ede5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:44 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:44 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "cinder-4cb6281f-6977-4645-a5d6-14e1cbf3bf92-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-4cb6281f-6977-4645-a5d6-14e1cbf3bf92-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "cinder-quobyte-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-quobyte-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8869fd-8f85-42cf-8d36-439fcce69f29]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:44 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Deleted volume successfully. Jul 11 04:10:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3a41f6e-f170-43ce-8580-ab85f1f737d4 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-1911f31e-c348-4fba-83ed-b5b134e224e2-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:44 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 Jul 11 04:10:44 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:45 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" returned: 0 in 0.861s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:45 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92 Jul 11 04:10:45 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:46 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" returned: 0 in 0.637s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-quobyte-4cb6281f-6977-4645-a5d6-14e1cbf3bf92" released by "delete_volume" :: held 1.552s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Created reservations ['2e89fabc-7e32-4eac-89bb-a139958fa7a0', 'afc97087-01a5-416c-a463-22c80f75a494', '5d032078-17b9-4f60-aa52-1e4c2b6c91eb', '2b95fc41-f666-47f1-9877-72d4257ed416'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:46 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:46 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "cinder-35eb2004-82ae-4170-a9ea-fa5fcfea6188-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-35eb2004-82ae-4170-a9ea-fa5fcfea6188-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:47 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "cinder-quobyte-35eb2004-82ae-4170-a9ea-fa5fcfea6188" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:10:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Deleted volume successfully. Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-quobyte-35eb2004-82ae-4170-a9ea-fa5fcfea6188" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9d5d27e9-99f8-4cbe-8761-255f845e359b tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-4cb6281f-6977-4645-a5d6-14e1cbf3bf92-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d016ac-7317-483c-9fd8-df7ad129c64c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:47 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 Jul 11 04:10:47 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:48 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188" returned: 0 in 0.997s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:48 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188 Jul 11 04:10:48 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:49 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-35eb2004-82ae-4170-a9ea-fa5fcfea6188" returned: 0 in 0.742s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-quobyte-35eb2004-82ae-4170-a9ea-fa5fcfea6188" released by "delete_volume" :: held 1.790s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Created reservations ['22c25fe4-acc5-44f9-8a1a-e44726d05013', '1ef5e837-cbc2-4720-a754-dc13996f0b4e', '8a42a5d5-8364-48a3-8a20-93c1fd2e3b3d', 'e99ca6ef-855f-457a-8e5a-77535439929c'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:49 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:10:49 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:50 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.782s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:50 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:10:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Deleted volume successfully. Jul 11 04:10:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d41e7aea-5408-4d66-bb40-bfe9ae987975 tempest-AttachVolumeNegativeTest-443475276 None] Lock "cinder-35eb2004-82ae-4170-a9ea-fa5fcfea6188-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:10:55 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Flow 'volume_create_manager' (4f8c6d8c-9ed4-4410-a03c-9508167bd92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368d31d8-7a85-43f3-ae14-f4e6c67be35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368d31d8-7a85-43f3-ae14-f4e6c67be35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-292864925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58faa6a8-9ccc-40f2-9013-19cb2db38d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c97a997830493a8c61694350097931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:10:56Z,use_quota=True,user_id='d31b982465574e8e9b3658ce062dd9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f853e118-dd11-4bb1-a549-6d8b510448c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f853e118-dd11-4bb1-a549-6d8b510448c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4770164f-f2c0-411f-88f2-6764d5af9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4770164f-f2c0-411f-88f2-6764d5af9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58faa6a8-9ccc-40f2-9013-19cb2db38d22', 'volume_name': 'volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d9aaab-7485-46e3-9d6f-085968c83237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d9aaab-7485-46e3-9d6f-085968c83237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ee1cca-3e9d-4191-a0bc-a979a42ac8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Volume 58faa6a8-9ccc-40f2-9013-19cb2db38d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22', 'volume_size': 1} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-292864925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58faa6a8-9ccc-40f2-9013-19cb2db38d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c97a997830493a8c61694350097931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:10:56Z,use_quota=True,user_id='d31b982465574e8e9b3658ce062dd9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Creating volume 58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:10:56 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:56 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 1073741824 Jul 11 04:10:56 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:56 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 1073741824" returned: 0 in 0.829s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:56 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:10:56 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:57 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.657s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ee1cca-3e9d-4191-a0bc-a979a42ac8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec29825-eb5c-45ee-8c51-7af6c0ac68b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:10:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Volume volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 (58faa6a8-9ccc-40f2-9013-19cb2db38d22): created successfully Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec29825-eb5c-45ee-8c51-7af6c0ac68b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:10:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Flow 'volume_create_manager' (4f8c6d8c-9ed4-4410-a03c-9508167bd92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:10:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-29ae3420-ffd6-47ab-81d0-704b4f85a531 tempest-SnapshotDependencyTests-1296918427 None] Created volume successfully. Jul 11 04:10:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:10:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:10:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Creating offline snapshot b4e65c3e-eb88-434f-bc19-c184c340c61f of volume 58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:10:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e2819-2759-4ae2-9d66-60c5f09ffd89]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:10:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:58 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:10:58 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:10:59 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 11 04:10:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.790s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:10:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:10:59 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f 1G Jul 11 04:10:59 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:00 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f 1G" returned: 0 in 0.859s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:00 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f Jul 11 04:11:00 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:00 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f" returned: 0 in 0.685s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:00 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f is being set with open permissions: ugo+rw Jul 11 04:11:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:00 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f Jul 11 04:11:00 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:01 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f" returned: 0 in 0.690s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:01 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info Jul 11 04:11:01 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:02 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info" returned: 0 in 0.688s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:02 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info is being set with open permissions: ugo+rw Jul 11 04:11:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:02 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info Jul 11 04:11:02 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:02 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.info" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.524s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9e0ff2a3-b448-4f9e-b0eb-b9a82f72146b tempest-SnapshotDependencyTests-1296918427 None] Create snapshot completed successfully Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Flow 'volume_create_manager' (bb5aff9f-18df-4069-9995-c64a8b8b934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75f61a3-a23c-4f07-aec8-ab54c7005118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75f61a3-a23c-4f07-aec8-ab54c7005118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c97a997830493a8c61694350097931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4e65c3e-eb88-434f-bc19-c184c340c61f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:04Z,use_quota=True,user_id='d31b982465574e8e9b3658ce062dd9c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3c9167-284a-4685-9f4f-94f79a234d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3c9167-284a-4685-9f4f-94f79a234d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa4e2ae-a9cf-4cf1-bfe1-e7cfd240609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa4e2ae-a9cf-4cf1-bfe1-e7cfd240609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d', 'volume_name': 'volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d', 'volume_size': 1, 'snapshot_id': 'b4e65c3e-eb88-434f-bc19-c184c340c61f'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb6c8ec-0e6e-4c22-adb7-4ecc5b061420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb6c8ec-0e6e-4c22-adb7-4ecc5b061420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d43b5fe-1bc1-4848-86d6-288cc7ee7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Volume 9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d', 'volume_size': 1, 'snapshot_id': 'b4e65c3e-eb88-434f-bc19-c184c340c61f'} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-quobyte-b4e65c3e-eb88-434f-bc19-c184c340c61f-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-b4e65c3e-eb88-434f-bc19-c184c340c61f-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Creating volume 9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d from snapshot b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-quobyte-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] snapshot: b4e65c3e-eb88-434f-bc19-c184c340c61f, volume: 9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff2edb-e699-499c-a5d3-5059f7bffdcf]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:04 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f Jul 11 04:11:04 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:05 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f" returned: 0 in 0.821s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:11:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:11:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:11:05 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f41a0a-75b5-4966-8728-101f8eec87e0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:05 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:11:05 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:06 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:06 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:11:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:06 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d Jul 11 04:11:06 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:08 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:11:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Flow 'volume_create_manager' (2e185b1f-3236-4066-8899-76fc3b46524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c646babf-22cc-49ed-86ac-efb734c55d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c646babf-22cc-49ed-86ac-efb734c55d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-335592487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91313ff5-493b-4915-8890-710fbeb26079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d839e918550477ba7b9d5ea47a08a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:09Z,use_quota=True,user_id='6d8837dcc07447baa81ac4d05b4398ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49326c2-0e42-4d02-8887-758060f105db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49326c2-0e42-4d02-8887-758060f105db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7465d8b-b13b-4fd7-baf0-a5d5b96011de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7465d8b-b13b-4fd7-baf0-a5d5b96011de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91313ff5-493b-4915-8890-710fbeb26079', 'volume_name': 'volume-91313ff5-493b-4915-8890-710fbeb26079', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8aea65-98a3-4cd1-8849-5e9929123d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8aea65-98a3-4cd1-8849-5e9929123d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175e73d7-98b5-44f6-b28a-c8dfefeb9298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Volume 91313ff5-493b-4915-8890-710fbeb26079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91313ff5-493b-4915-8890-710fbeb26079', 'volume_size': 1} Jul 11 04:11:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:10 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" returned: 0 in 4.546s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e647005-6179-4442-b59b-dec6f4fc56fc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:10 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:11:10 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:11 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.918s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:11 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:11:11 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Converted 1024.00 MB image at 225.15 MB/s Jul 11 04:11:11 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d is being set with open permissions: ugo+rw Jul 11 04:11:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:11 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d Jul 11 04:11:11 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:12 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" returned: 0 in 0.612s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" released by "_copy_volume_from_snapshot" :: held 7.743s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-b4e65c3e-eb88-434f-bc19-c184c340c61f-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" released by "_create_volume_from_snapshot" :: held 7.779s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.799s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.046s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-335592487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91313ff5-493b-4915-8890-710fbeb26079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d839e918550477ba7b9d5ea47a08a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:09Z,use_quota=True,user_id='6d8837dcc07447baa81ac4d05b4398ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Creating volume 91313ff5-493b-4915-8890-710fbeb26079 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:11:12 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:12 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 1073741824 Jul 11 04:11:12 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d43b5fe-1bc1-4848-86d6-288cc7ee7d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d', 'volume_size': 1, 'snapshot_id': 'b4e65c3e-eb88-434f-bc19-c184c340c61f'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1895652-1086-44af-935e-d8935c1a3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Volume volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d (9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d): created successfully Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1895652-1086-44af-935e-d8935c1a3433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Flow 'volume_create_manager' (bb5aff9f-18df-4069-9995-c64a8b8b934e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-88ca7886-c532-484a-8349-3b9e74fc3fe1 tempest-SnapshotDependencyTests-1296918427 None] Created volume successfully. Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-b4e65c3e-eb88-434f-bc19-c184c340c61f-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-b4e65c3e-eb88-434f-bc19-c184c340c61f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-quobyte-58faa6a8-9ccc-40f2-9013-19cb2db38d22" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-58faa6a8-9ccc-40f2-9013-19cb2db38d22" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-quobyte-b4e65c3e-eb88-434f-bc19-c184c340c61f" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-b4e65c3e-eb88-434f-bc19-c184c340c61f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Deleting offline snapshot b4e65c3e-eb88-434f-bc19-c184c340c61f of volume 58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] snapshot_file for this snap is: volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:11:13 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 1073741824" returned: 0 in 0.908s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb89b94-ebe6-4005-97c3-22bf361a8755]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:13 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 Jul 11 04:11:13 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:13 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f Jul 11 04:11:13 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:13 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079" returned: 0 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175e73d7-98b5-44f6-b28a-c8dfefeb9298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91313ff5-493b-4915-8890-710fbeb26079', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feffa444-a5da-44e8-a195-02b1c9c49748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:13 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Volume volume-91313ff5-493b-4915-8890-710fbeb26079 (91313ff5-493b-4915-8890-710fbeb26079): created successfully Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feffa444-a5da-44e8-a195-02b1c9c49748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Flow 'volume_create_manager' (2e185b1f-3236-4066-8899-76fc3b46524b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:13 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f" returned: 0 in 0.774s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:11:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9c820ae8-38ff-4ac6-9547-fe354383c738 tempest-VolumesTransfersV355Test-895345145 None] Created volume successfully. Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf15f2a-b9b4-44cb-afd4-fcaa3a0c5c1f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:13 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:11:13 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:14 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:14 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:14 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.782s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:14 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f Jul 11 04:11:14 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:14 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:11:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:11:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e64a60da-b65b-4040-9797-491a0e0f7245 tempest-VolumesTransfersV355Test-934070182 None] Transfer volume completed successfully. Jul 11 04:11:15 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:15 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f Jul 11 04:11:15 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Acquiring lock "cinder-91313ff5-493b-4915-8890-710fbeb26079-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-91313ff5-493b-4915-8890-710fbeb26079-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Acquiring lock "cinder-quobyte-91313ff5-493b-4915-8890-710fbeb26079" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-quobyte-91313ff5-493b-4915-8890-710fbeb26079" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1417366-a1a4-454e-a012-cd5720443122]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:16 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22.b4e65c3e-eb88-434f-bc19-c184c340c61f" returned: 0 in 0.669s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:16 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 Jul 11 04:11:16 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-b4e65c3e-eb88-434f-bc19-c184c340c61f" released by "_delete_snapshot" :: held 3.091s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-58faa6a8-9ccc-40f2-9013-19cb2db38d22" released by "delete_snapshot" :: held 3.122s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Created reservations ['de71e06d-aadc-430c-a848-7d820efec74a', 'ee56eb64-f090-401f-a59f-527c80973f08', 'b9bc23fb-4bcc-4619-8de5-cb951349bc35', 'b8146029-bb3f-4da0-91cf-089937ec65ac'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Delete snapshot completed successfully. Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0416cde-64f3-4215-9a48-0656c9fc7386 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-b4e65c3e-eb88-434f-bc19-c184c340c61f-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:16 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079" returned: 0 in 0.737s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:16 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079 Jul 11 04:11:16 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-58faa6a8-9ccc-40f2-9013-19cb2db38d22-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-58faa6a8-9ccc-40f2-9013-19cb2db38d22-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-quobyte-58faa6a8-9ccc-40f2-9013-19cb2db38d22" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-58faa6a8-9ccc-40f2-9013-19cb2db38d22" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e89bad-89e6-4f22-bfb8-db52dbba30ba]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:17 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-91313ff5-493b-4915-8890-710fbeb26079" returned: 0 in 0.646s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-quobyte-91313ff5-493b-4915-8890-710fbeb26079" released by "delete_volume" :: held 1.427s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:17 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:11:17 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Created reservations ['c2955e5e-b1a8-4f4e-b571-729d70334543', '8c66a9ab-a82a-4968-967d-227f23e8efbb', '97239c88-bb06-462b-830e-b7f64bb34150', 'd9b68df6-a3e7-477b-bb61-806932bb7a98'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:17 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:17 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:18 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.769s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:18 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22 Jul 11 04:11:18 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:18 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.716s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Deleted volume successfully. Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-3b8bc3ed-e775-45ca-9f33-696b47c9318f tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-91313ff5-493b-4915-8890-710fbeb26079-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Flow 'volume_create_manager' (1b2f0225-bcea-45ad-a27c-3e99636e0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b6fa78-0aa5-4c34-a0a7-7424dbaa925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b6fa78-0aa5-4c34-a0a7-7424dbaa925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-569388894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd74bcd-d5de-4700-ab4b-13cad0d53b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d839e918550477ba7b9d5ea47a08a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:19Z,use_quota=True,user_id='6d8837dcc07447baa81ac4d05b4398ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9384f0d2-0c0e-4786-9b40-119dda905170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9384f0d2-0c0e-4786-9b40-119dda905170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e585e06-4954-4b22-b3f0-dba7a7950140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e585e06-4954-4b22-b3f0-dba7a7950140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd74bcd-d5de-4700-ab4b-13cad0d53b01', 'volume_name': 'volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a429f-c41c-4f6c-90ee-4ee1a94c5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9a429f-c41c-4f6c-90ee-4ee1a94c5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431bf7d0-3fc6-4e74-a76c-d6fab9e43d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Volume 8bd74bcd-d5de-4700-ab4b-13cad0d53b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01', 'volume_size': 1} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-569388894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd74bcd-d5de-4700-ab4b-13cad0d53b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d839e918550477ba7b9d5ea47a08a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:19Z,use_quota=True,user_id='6d8837dcc07447baa81ac4d05b4398ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Creating volume 8bd74bcd-d5de-4700-ab4b-13cad0d53b01 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:11:18 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:18 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 1073741824 Jul 11 04:11:18 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:18 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-58faa6a8-9ccc-40f2-9013-19cb2db38d22" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-58faa6a8-9ccc-40f2-9013-19cb2db38d22" released by "delete_volume" :: held 1.547s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Created reservations ['ce66f6b3-ab5d-45b2-b228-203a076bc204', 'ee89af96-ca3b-4cd9-8e15-c9851faa8b04', 'f8345e8e-4fdb-4d38-822d-400d9f36d289', '86e31411-968b-4ab3-99db-edf74eb33df4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:18 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:18 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "cinder-quobyte-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[469901a6-7ac7-4254-a94b-82e58e64621f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:19 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 1073741824" returned: 0 in 0.923s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:19 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Deleted volume successfully. Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-347c3491-d742-4229-8a14-14b57b52c8e5 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-58faa6a8-9ccc-40f2-9013-19cb2db38d22-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:19 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d Jul 11 04:11:19 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:19 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 Jul 11 04:11:19 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:20 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01" returned: 0 in 0.651s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:20 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431bf7d0-3fc6-4e74-a76c-d6fab9e43d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e7cb19-1abd-48b7-9979-facb80cdbf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" returned: 0 in 0.765s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Volume volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 (8bd74bcd-d5de-4700-ab4b-13cad0d53b01): created successfully Jul 11 04:11:20 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d Jul 11 04:11:20 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e7cb19-1abd-48b7-9979-facb80cdbf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Flow 'volume_create_manager' (1b2f0225-bcea-45ad-a27c-3e99636e0bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d6c58aac-1076-402f-a286-51946e153962 tempest-VolumesTransfersV355Test-895345145 None] Created volume successfully. Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Acquiring lock "cinder-8bd74bcd-d5de-4700-ab4b-13cad0d53b01-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-8bd74bcd-d5de-4700-ab4b-13cad0d53b01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:20 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-quobyte-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d" released by "delete_volume" :: held 1.468s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Acquiring lock "cinder-quobyte-8bd74bcd-d5de-4700-ab4b-13cad0d53b01" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-quobyte-8bd74bcd-d5de-4700-ab4b-13cad0d53b01" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd65440-fb8c-477c-bee5-4ee0dc57366c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Created reservations ['6e2b3003-644d-471d-8092-6cb62bf2398b', 'b06758b7-b3ee-42de-9f4d-08a197ee8679', 'bb7517ee-062d-40ba-baec-1bd443571208', '58927b6c-b2a1-4c46-b160-a323f5fb0b86'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:21 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:21 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:21 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 Jul 11 04:11:21 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:21 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Deleted volume successfully. Jul 11 04:11:21 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01" returned: 0 in 0.777s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dce847b7-13e9-471d-9392-9df0896dfea2 tempest-SnapshotDependencyTests-1296918427 None] Lock "cinder-9eb0ccdf-dc93-41fb-8a78-63ae0a0fe16d-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:21 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01 Jul 11 04:11:21 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:22 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8bd74bcd-d5de-4700-ab4b-13cad0d53b01" returned: 0 in 0.680s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-quobyte-8bd74bcd-d5de-4700-ab4b-13cad0d53b01" released by "delete_volume" :: held 1.502s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Created reservations ['ede7c859-dd15-4408-a51f-7b0efddc3f11', 'ec76fa9d-cd46-4908-885a-6e4323d987b7', '690762aa-547b-4a02-843c-85de5541462d', 'c25a6810-841d-466d-bd37-e81d3a82fca1'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:22 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:22 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:23 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.684s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Deleted volume successfully. Jul 11 04:11:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e7a87f04-583d-41a4-91b0-31963a0500fe tempest-VolumesTransfersV355Test-1689337971 None] Lock "cinder-8bd74bcd-d5de-4700-ab4b-13cad0d53b01-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Flow 'volume_create_manager' (3c1b3daf-9b70-44c7-a459-e4abfc8eee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a240b00-6133-4bbc-940f-d5652d488b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a240b00-6133-4bbc-940f-d5652d488b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-358270280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837060a2-637e-4bfc-8a97-0ea5f7bc7258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ddd32679294dfb8aeb5099aad241f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:29Z,use_quota=True,user_id='21954da1b24f472fbba22c2c8be412aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b40709e-b2a4-4402-883e-7f83ccda1255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b40709e-b2a4-4402-883e-7f83ccda1255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636ce04f-6abe-40a2-b734-4671b7489de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636ce04f-6abe-40a2-b734-4671b7489de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837060a2-637e-4bfc-8a97-0ea5f7bc7258', 'volume_name': 'volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258', 'volume_size': 2}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b96f268-32e5-445c-8c00-3d8e897bbcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b96f268-32e5-445c-8c00-3d8e897bbcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee6286d-846f-4f40-ad62-72c871f395eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:29 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Volume 837060a2-637e-4bfc-8a97-0ea5f7bc7258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258', 'volume_size': 2} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-358270280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837060a2-637e-4bfc-8a97-0ea5f7bc7258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ddd32679294dfb8aeb5099aad241f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:29Z,use_quota=True,user_id='21954da1b24f472fbba22c2c8be412aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Creating volume 837060a2-637e-4bfc-8a97-0ea5f7bc7258 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:11:29 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:11:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 2147483648 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:29 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 2147483648 Jul 11 04:11:29 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:30 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 2147483648" returned: 0 in 0.971s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:30 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 Jul 11 04:11:30 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:31 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee6286d-846f-4f40-ad62-72c871f395eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258', 'volume_size': 2}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8104f2-3c4b-4bdb-9d0f-b5d7ae18796f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Volume volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 (837060a2-637e-4bfc-8a97-0ea5f7bc7258): created successfully Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8104f2-3c4b-4bdb-9d0f-b5d7ae18796f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Flow 'volume_create_manager' (3c1b3daf-9b70-44c7-a459-e4abfc8eee2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4a92dd11-b78f-4dd1-8361-6ba32369f15b tempest-VolumesCloneNegativeTest-905262134 None] Created volume successfully. Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Acquiring lock "cinder-837060a2-637e-4bfc-8a97-0ea5f7bc7258-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Lock "cinder-837060a2-637e-4bfc-8a97-0ea5f7bc7258-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Acquiring lock "cinder-quobyte-837060a2-637e-4bfc-8a97-0ea5f7bc7258" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Lock "cinder-quobyte-837060a2-637e-4bfc-8a97-0ea5f7bc7258" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc25c0-c85f-49c2-b44a-0efc88b2647a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:31 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 Jul 11 04:11:31 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:32 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258" returned: 0 in 0.758s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:32 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258 Jul 11 04:11:32 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:32 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-837060a2-637e-4bfc-8a97-0ea5f7bc7258" returned: 0 in 0.629s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Lock "cinder-quobyte-837060a2-637e-4bfc-8a97-0ea5f7bc7258" released by "delete_volume" :: held 1.432s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:32 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Created reservations ['33978556-8ed0-4480-aec7-87c3b446c098', 'cf120daf-2958-4869-9618-e5e6d66eef4d', 'e577f91b-550c-4de4-b72b-b046308b258f', '41f438a6-b109-4e12-9443-a6d762fc5247'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:33 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:33 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:33 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.651s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Deleted volume successfully. Jul 11 04:11:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-77863f91-582a-4604-b98a-aedcf1d24562 tempest-VolumesCloneNegativeTest-905262134 None] Lock "cinder-837060a2-637e-4bfc-8a97-0ea5f7bc7258-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Flow 'volume_create_manager' (b01938ef-f60f-4a67-951b-282697559c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30274bc6-514d-421a-bc49-72dc0389e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30274bc6-514d-421a-bc49-72dc0389e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-468623265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a6d027-b801-42b6-bcc5-29aa1b136738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a15cc7d7b64976acf917a20566fcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:37Z,use_quota=True,user_id='336926d794f54fa0aebc7e6a81dda0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf33e02-c7ed-42da-a89d-df86923ac39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf33e02-c7ed-42da-a89d-df86923ac39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff98c51-ce74-44e2-af21-410e19daebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:36 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff98c51-ce74-44e2-af21-410e19daebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2a6d027-b801-42b6-bcc5-29aa1b136738', 'volume_name': 'volume-d2a6d027-b801-42b6-bcc5-29aa1b136738', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b634db-636e-432a-b82e-80ad70512273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b634db-636e-432a-b82e-80ad70512273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15903011-ef67-43d7-bd8e-d46f6f95d338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:37 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Volume d2a6d027-b801-42b6-bcc5-29aa1b136738: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2a6d027-b801-42b6-bcc5-29aa1b136738', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Trying to clone d2a6d027-b801-42b6-bcc5-29aa1b136738 from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:11:37 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e64fadf-c4bd-49be-83e0-f30572ac19cc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:37 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD Jul 11 04:11:37 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:38 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:38 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 is fetched for user 336926d794f54fa0aebc7e6a81dda0ed. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:11:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8f3560-22ea-4d97-8f60-b56d9434799e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:38 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD Jul 11 04:11:38 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:39 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-468623265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a6d027-b801-42b6-bcc5-29aa1b136738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a15cc7d7b64976acf917a20566fcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:37Z,use_quota=True,user_id='336926d794f54fa0aebc7e6a81dda0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Creating volume d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:11:39 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:39 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 1073741824 Jul 11 04:11:39 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:39 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 1073741824" returned: 0 in 0.849s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:39 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:39 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:40 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:11:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:40 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Attempting download of 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume d2a6d027-b801-42b6-bcc5-29aa1b136738. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:11:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647c2dd-d8c6-439f-b079-f69854fe2ad2]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:40 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a Jul 11 04:11:40 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:41 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a" returned: 0 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:41 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a Jul 11 04:11:41 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:42 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a" returned: 1 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_6gpyyt1a' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c59984-5f46-45bd-ab44-a58da72dbe89]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:42 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD Jul 11 04:11:42 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:42 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] 80fd31bb-c6c3-4f44-9f5f-61edc167e142 was qcow2, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:11:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:42 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:42 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:44 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 0 in 1.711s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:44 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_pkiw09ugdevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:11:44 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Converted 112.00 MB image at 65.40 MB/s Jul 11 04:11:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:44 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 1G Jul 11 04:11:44 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:45 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 1G" returned: 0 in 0.667s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[016cb218-f6d7-44c7-8a7a-42123ce2b00e]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:45 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:45 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:45 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:46 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:46 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:46 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 1 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Downloaded image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume d2a6d027-b801-42b6-bcc5-29aa1b136738 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 for user 336926d794f54fa0aebc7e6a81dda0ed is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Marking volume d2a6d027-b801-42b6-bcc5-29aa1b136738 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=65,cinder:INSERT=22,cinder:UPDATE=83,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Copying metadata from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 to d2a6d027-b801-42b6-bcc5-29aa1b136738. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Creating volume glance metadata for volume d2a6d027-b801-42b6-bcc5-29aa1b136738 backed by image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=94,cinder:SELECT=63,cinder:INSERT=21,cinder:DELETE=12 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15903011-ef67-43d7-bd8e-d46f6f95d338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a6d027-b801-42b6-bcc5-29aa1b136738', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68593d81-d726-47d5-ae1c-a0cf8f15cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:46 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Volume volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 (d2a6d027-b801-42b6-bcc5-29aa1b136738): created successfully Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68593d81-d726-47d5-ae1c-a0cf8f15cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Flow 'volume_create_manager' (b01938ef-f60f-4a67-951b-282697559c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-164fb0ea-123d-456f-ad88-10075d11b56d tempest-VolumesExtendTest-529303091 None] Created volume successfully. Jul 11 04:11:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:47 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3146eb49-823b-42b1-bbcc-02d0faf8ab00]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:47 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:47 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:48 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:48 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:48 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:48 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 1 in 0.748s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:11:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 2G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 2G" returned: 0 in 0.059s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.644s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3352f835-493a-4e4c-b17d-cd5881c9a679 tempest-VolumesExtendTest-529303091 None] Extend volume completed successfully. Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-d2a6d027-b801-42b6-bcc5-29aa1b136738-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Lock "cinder-d2a6d027-b801-42b6-bcc5-29aa1b136738-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-quobyte-d2a6d027-b801-42b6-bcc5-29aa1b136738" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-d2a6d027-b801-42b6-bcc5-29aa1b136738" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6687a-2be0-4926-ac4f-35d1ebde8c74]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:50 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:50 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:50 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 0 in 0.760s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:50 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:50 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:51 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 1 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:11:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:51 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738 Jul 11 04:11:51 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:52 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d2a6d027-b801-42b6-bcc5-29aa1b136738" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-d2a6d027-b801-42b6-bcc5-29aa1b136738" released by "delete_volume" :: held 2.235s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Created reservations ['d6afbf0d-3c23-40e6-9dc6-61da2f111d53', '900dae07-70f7-4aa4-aad2-322ce6255f98', '7128ac25-03c7-4b53-b2f2-3c2c39d92be1', '6d6fd148-f64a-4032-a6c0-cba894e0beca'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:52 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:11:52 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:52 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:11:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Deleted volume successfully. Jul 11 04:11:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-279119a9-afae-4fcb-93fd-28787d940ded tempest-VolumesExtendTest-529303091 None] Lock "cinder-d2a6d027-b801-42b6-bcc5-29aa1b136738-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Flow 'volume_create_manager' (1a704246-19f9-42d2-a8aa-82332f30f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b36482-59f6-4a7b-bd99-ff1b5cc8016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b36482-59f6-4a7b-bd99-ff1b5cc8016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1646184265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c92618d-ec79-422c-9d0c-8a30f377a489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a15cc7d7b64976acf917a20566fcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:53Z,use_quota=True,user_id='336926d794f54fa0aebc7e6a81dda0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791e7dc3-ebc5-44ac-8de0-860ed5be21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791e7dc3-ebc5-44ac-8de0-860ed5be21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f13b9a0-afc2-4389-b114-2519750ac1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f13b9a0-afc2-4389-b114-2519750ac1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c92618d-ec79-422c-9d0c-8a30f377a489', 'volume_name': 'volume-6c92618d-ec79-422c-9d0c-8a30f377a489', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51544c50-73fe-49d1-8141-63339b48c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51544c50-73fe-49d1-8141-63339b48c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6908c7-4106-4d7f-bb93-6e14883468ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:53 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Volume 6c92618d-ec79-422c-9d0c-8a30f377a489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c92618d-ec79-422c-9d0c-8a30f377a489', 'volume_size': 1} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1646184265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c92618d-ec79-422c-9d0c-8a30f377a489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96a15cc7d7b64976acf917a20566fcf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:11:53Z,use_quota=True,user_id='336926d794f54fa0aebc7e6a81dda0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Creating volume 6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:11:53 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:11:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:53 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 1073741824 Jul 11 04:11:53 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:54 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 1073741824" returned: 0 in 0.781s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:54 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 Jul 11 04:11:54 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:55 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489" returned: 0 in 0.626s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e6908c7-4106-4d7f-bb93-6e14883468ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c92618d-ec79-422c-9d0c-8a30f377a489', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514cdb4c-9fa1-479f-a992-736ceaa45c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:11:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Volume volume-6c92618d-ec79-422c-9d0c-8a30f377a489 (6c92618d-ec79-422c-9d0c-8a30f377a489): created successfully Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514cdb4c-9fa1-479f-a992-736ceaa45c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Flow 'volume_create_manager' (1a704246-19f9-42d2-a8aa-82332f30f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:11:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-618be182-3109-4d39-a218-f350a98f4f8a tempest-VolumesExtendTest-529303091 None] Created volume successfully. Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Creating offline snapshot 597fbe0e-cfc3-4b7d-b46c-a65e8d460911 of volume 6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[41615338-3f96-4695-99c9-0f317cb7b76f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:11:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:55 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 Jul 11 04:11:55 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:56 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489" returned: 0 in 0.715s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:56 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 1G Jul 11 04:11:56 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:57 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 1G" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c92618d-ec79-422c-9d0c-8a30f377a489 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:57 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c92618d-ec79-422c-9d0c-8a30f377a489 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 Jul 11 04:11:57 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:58 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c92618d-ec79-422c-9d0c-8a30f377a489 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911" returned: 0 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:58 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 is being set with open permissions: ugo+rw Jul 11 04:11:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:58 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 Jul 11 04:11:58 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:58 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911" returned: 0 in 0.650s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:58 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info Jul 11 04:11:58 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:59 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info" returned: 0 in 0.637s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:59 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info is being set with open permissions: ugo+rw Jul 11 04:11:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:11:59 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info Jul 11 04:11:59 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:11:59 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 11 04:11:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.info" returned: 0 in 0.629s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:11:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.199s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:00 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4e304967-1ddf-4750-aa63-16ebf679e292 tempest-VolumesExtendTest-529303091 None] Create snapshot completed successfully Jul 11 04:12:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c886bd2f-7abc-489e-8327-1e7efd3d7569]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:01 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 Jul 11 04:12:01 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:01 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489" returned: 0 in 0.778s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 2G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 2G" returned: 0 in 0.119s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.925s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-31100402-4bb2-4549-9b92-ce534d23e1da tempest-VolumesExtendTest-529303091 None] Extend volume completed successfully. Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-597fbe0e-cfc3-4b7d-b46c-a65e8d460911-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Lock "cinder-597fbe0e-cfc3-4b7d-b46c-a65e8d460911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-quobyte-6c92618d-ec79-422c-9d0c-8a30f377a489" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-6c92618d-ec79-422c-9d0c-8a30f377a489" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-quobyte-597fbe0e-cfc3-4b7d-b46c-a65e8d460911" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-597fbe0e-cfc3-4b7d-b46c-a65e8d460911" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Deleting offline snapshot 597fbe0e-cfc3-4b7d-b46c-a65e8d460911 of volume 6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] snapshot_file for this snap is: volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f16f5-5794-4e13-94d4-7a2c7c9387ab]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:02 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 Jul 11 04:12:02 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:03 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c92618d-ec79-422c-9d0c-8a30f377a489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:12:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d68ca4-8dbc-425e-9ec2-ddb2ac13166c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:03 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 Jul 11 04:12:03 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:03 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489" returned: 0 in 0.714s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:03 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 Jul 11 04:12:03 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:04 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:04 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911 Jul 11 04:12:04 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:05 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489.597fbe0e-cfc3-4b7d-b46c-a65e8d460911" returned: 0 in 0.608s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-597fbe0e-cfc3-4b7d-b46c-a65e8d460911" released by "_delete_snapshot" :: held 2.860s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-6c92618d-ec79-422c-9d0c-8a30f377a489" released by "delete_snapshot" :: held 2.880s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Created reservations ['a9cbc715-eaca-421c-ab73-1518212ecb66', '85d0f637-898d-4a34-86b8-ccc41ac56adc', 'f30ca32d-5ebb-4b8c-ba04-af00f65967d7', 'c6f971b4-eb9f-46c4-ae9a-0234c852a88f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Delete snapshot completed successfully. Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6589bfee-f5e7-43a7-bbc1-3fc3241ffe9b tempest-VolumesExtendTest-529303091 None] Lock "cinder-597fbe0e-cfc3-4b7d-b46c-a65e8d460911-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-6c92618d-ec79-422c-9d0c-8a30f377a489-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Lock "cinder-6c92618d-ec79-422c-9d0c-8a30f377a489-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Acquiring lock "cinder-quobyte-6c92618d-ec79-422c-9d0c-8a30f377a489" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-6c92618d-ec79-422c-9d0c-8a30f377a489" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[189817b5-de57-4038-8ee9-94a815512e50]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:05 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 Jul 11 04:12:05 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:06 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:06 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489 Jul 11 04:12:06 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:07 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6c92618d-ec79-422c-9d0c-8a30f377a489" returned: 0 in 0.612s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Lock "cinder-quobyte-6c92618d-ec79-422c-9d0c-8a30f377a489" released by "delete_volume" :: held 1.407s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Created reservations ['12b38d47-1671-4c7b-b7e5-412cf96f3754', '158b922c-9e34-442c-b933-8cb37059ce4d', '0c28a062-ba8c-4757-a323-b7c92c82a819', '2b6c80d2-c525-4f8f-99fb-b3f3a1b00af5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:07 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:07 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:07 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Deleted volume successfully. Jul 11 04:12:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2d4cdebe-efa3-44df-8572-287e6d872b99 tempest-VolumesExtendTest-529303091 None] Lock "cinder-6c92618d-ec79-422c-9d0c-8a30f377a489-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (df8bc044-512a-4ee6-8bde-66cc6cd8bd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934ecd6-b920-4824-b9ae-7c19aecf7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0934ecd6-b920-4824-b9ae-7c19aecf7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1901292481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:10Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983a44d4-9643-42e0-bdbe-4169f92daada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983a44d4-9643-42e0-bdbe-4169f92daada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b80460-b40f-4710-af1a-0f7a890fdb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b80460-b40f-4710-af1a-0f7a890fdb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c', 'volume_name': 'volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57cfb4f-b2a1-43f4-a79b-23ac9afae401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57cfb4f-b2a1-43f4-a79b-23ac9afae401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec970e73-7049-445b-a3fa-062e667e31ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Volume ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c', 'volume_size': 1} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1901292481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:10Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Creating volume ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:12:10 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:12:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:10 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c 1073741824 Jul 11 04:12:10 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:11 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c 1073741824" returned: 0 in 0.819s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:11 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c Jul 11 04:12:11 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:11 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec970e73-7049-445b-a3fa-062e667e31ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e9576e-c6dd-43aa-a4b1-54675beb2875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:11 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Volume volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c (ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c): created successfully Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e9576e-c6dd-43aa-a4b1-54675beb2875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (df8bc044-512a-4ee6-8bde-66cc6cd8bd9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f459d564-45e6-4e9a-9d53-17386c6f7f97 tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (bc9aba51-63cf-49c0-9c02-5829357298b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d170e95d-19c3-4674-baa1-f801743794b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d170e95d-19c3-4674-baa1-f801743794b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-592361832',display_name='tempest-VolumesGetTest-Volume-1053916507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:13Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090e39f0-aff6-4711-89e0-1d880bbd987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090e39f0-aff6-4711-89e0-1d880bbd987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77b5824-f138-4864-8d64-8447c7040669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77b5824-f138-4864-8d64-8447c7040669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1', 'volume_name': 'volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f769717d-da1f-48a3-ab13-f3c86e21783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f769717d-da1f-48a3-ab13-f3c86e21783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e87133-adce-4c38-98d6-38f0fdb25a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:13 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Volume 8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1', 'volume_size': 1} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-592361832',display_name='tempest-VolumesGetTest-Volume-1053916507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:13Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Creating volume 8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:12:13 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:12:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:13 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 1073741824 Jul 11 04:12:13 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:14 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 1073741824" returned: 0 in 0.878s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:14 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 Jul 11 04:12:14 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:14 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:14 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:14 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1" returned: 0 in 0.632s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e87133-adce-4c38-98d6-38f0fdb25a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab590b-f187-4604-866d-0463d1a4c683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:14 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Volume volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 (8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1): created successfully Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ab590b-f187-4604-866d-0463d1a4c683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (bc9aba51-63cf-49c0-9c02-5829357298b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9590a5f0-caeb-4364-a6bb-b2c51eef23f8 tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:12:14 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:12:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:12:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Lock "cinder-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadd486f-2c78-46b8-97ec-55f3155075b4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:15 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 Jul 11 04:12:15 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:16 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:16 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1 Jul 11 04:12:16 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:16 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1" returned: 0 in 0.620s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1" released by "delete_volume" :: held 1.420s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Created reservations ['40964c19-08bb-48b1-a7a7-538225261ec4', 'f050cf31-58a8-4f75-802b-90c5a20b9a84', '0652783b-b380-40d8-b2a0-c88edacfe13d', '4247b529-0c5f-4a9f-8389-0f67db850a2b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:16 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:16 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:17 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.636s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:17 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5a49b801-7f08-4023-9021-bf76f45131d8 tempest-VolumesGetTest-1272785730 None] Lock "cinder-8fd791f8-a6d4-4abc-92bb-8035bdc3f9f1-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Lock "cinder-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b59cfaf-3dea-4237-a59f-24c44309afa3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:17 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c Jul 11 04:12:17 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:18 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:18 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c Jul 11 04:12:18 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:19 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c" returned: 0 in 0.624s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c" released by "delete_volume" :: held 1.397s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Created reservations ['ea8a7825-f971-4b2b-b9a5-3274d83bd1a3', '95ec3466-9a60-4db5-be5a-ffa854afb3e7', 'c61859ca-3fe5-4056-bdbc-4aa98c47592b', '35329b59-98e4-450f-945e-4f9f94adb528'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:19 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:19 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:19 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:12:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6d98781c-6d92-449e-9e3a-f58978632485 tempest-VolumesGetTest-1272785730 None] Lock "cinder-ffa1165e-2ac3-4ef1-ac58-8d06b56bc95c-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (6222752d-95dc-4563-b880-7a1b5cd104bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cfcf37-f5e6-4bed-a6a1-0d342b712552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cfcf37-f5e6-4bed-a6a1-0d342b712552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1028043614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61aa057-8e70-4ac2-9f12-d254e4512e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:20Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970541b8-363f-40ff-99e0-7ffc279deb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970541b8-363f-40ff-99e0-7ffc279deb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b608f66-9bb5-42ec-8f0b-2679adc6de64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b608f66-9bb5-42ec-8f0b-2679adc6de64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61aa057-8e70-4ac2-9f12-d254e4512e43', 'volume_name': 'volume-d61aa057-8e70-4ac2-9f12-d254e4512e43', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c44de29-0863-4677-a9ca-6db7a3cf91f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c44de29-0863-4677-a9ca-6db7a3cf91f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481dcd67-43da-4355-bcf2-5123228cebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:20 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Volume d61aa057-8e70-4ac2-9f12-d254e4512e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61aa057-8e70-4ac2-9f12-d254e4512e43', 'volume_size': 1} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1028043614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61aa057-8e70-4ac2-9f12-d254e4512e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:20Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Creating volume d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:12:20 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:12:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:20 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 1073741824 Jul 11 04:12:20 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:21 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 1073741824" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:21 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:21 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:21 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.610s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481dcd67-43da-4355-bcf2-5123228cebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61aa057-8e70-4ac2-9f12-d254e4512e43', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca0018f-c6f0-4b48-b402-9e471f42e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:21 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Volume volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 (d61aa057-8e70-4ac2-9f12-d254e4512e43): created successfully Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca0018f-c6f0-4b48-b402-9e471f42e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:21 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (6222752d-95dc-4563-b880-7a1b5cd104bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-79d3f4f0-97aa-4686-b3f5-ed78a33045a3 tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:12:22 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (8410ef37-7b08-4a24-a75d-0ba17ac2605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:22 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e02e9d-f7b4-4a9c-a5f6-e76ce09a8796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e02e9d-f7b4-4a9c-a5f6-e76ce09a8796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1227500025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b12123e5-8196-4fb0-b792-40cb2e69b9e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d61aa057-8e70-4ac2-9f12-d254e4512e43,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:23Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071c8e5b-9a2a-4ccf-9f86-a5f0807d845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071c8e5b-9a2a-4ccf-9f86-a5f0807d845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d9ba70-a81b-48c4-93d9-c94f1503f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d9ba70-a81b-48c4-93d9-c94f1503f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b12123e5-8196-4fb0-b792-40cb2e69b9e9', 'volume_name': 'volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9', 'volume_size': 1, 'source_volid': 'd61aa057-8e70-4ac2-9f12-d254e4512e43', 'source_volstatus': 'available'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d63736-4c6c-4359-ba0f-366f6f99b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d63736-4c6c-4359-ba0f-366f6f99b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227e1882-a99a-48b3-ab59-0858bc855ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:23 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Volume b12123e5-8196-4fb0-b792-40cb2e69b9e9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9', 'volume_size': 1, 'source_volid': 'd61aa057-8e70-4ac2-9f12-d254e4512e43', 'source_volstatus': 'available'} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:23 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Cloning volume d61aa057-8e70-4ac2-9f12-d254e4512e43 to volume b12123e5-8196-4fb0-b792-40cb2e69b9e9 Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Creating offline snapshot 4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 of volume d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[088908ec-5e68-4325-a66b-f344680273d2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:23 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:23 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:23 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.782s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:23 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 1G Jul 11 04:12:23 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:24 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 1G" returned: 0 in 0.789s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:24 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 Jul 11 04:12:24 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:25 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:25 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 is being set with open permissions: ugo+rw Jul 11 04:12:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:25 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 Jul 11 04:12:25 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:25 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" returned: 0 in 0.613s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:26 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info Jul 11 04:12:26 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:26 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:26 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info is being set with open permissions: ugo+rw Jul 11 04:12:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:26 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info Jul 11 04:12:26 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:27 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.info" returned: 0 in 0.615s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-b12123e5-8196-4fb0-b792-40cb2e69b9e9" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-b12123e5-8196-4fb0-b792-40cb2e69b9e9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] snapshot: 4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376, volume: b12123e5-8196-4fb0-b792-40cb2e69b9e9, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[136198b2-70ea-4bb1-83dc-dfeea86fd839]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:27 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 Jul 11 04:12:27 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:28 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61aa057-8e70-4ac2-9f12-d254e4512e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[74907caf-703a-43ab-be95-467c53b199cf]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:28 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:28 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:28 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:12:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:28 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 Jul 11 04:12:28 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:32 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9" returned: 0 in 4.117s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:32 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[111b7442-fc7b-4d0d-a53c-86a1a87266ab]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:33 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:33 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:33 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.872s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:33 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:12:33 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Converted 1024.00 MB image at 248.63 MB/s Jul 11 04:12:33 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 is being set with open permissions: ugo+rw Jul 11 04:12:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:33 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 Jul 11 04:12:33 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:34 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9" returned: 0 in 0.601s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-b12123e5-8196-4fb0-b792-40cb2e69b9e9" released by "_copy_volume_from_snapshot" :: held 7.212s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Deleting offline snapshot 4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 of volume d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] snapshot_file for this snap is: volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5994953b-32c8-4784-a66d-64b3a5f430ae]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:34 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 Jul 11 04:12:34 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:35 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" returned: 0 in 0.712s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61aa057-8e70-4ac2-9f12-d254e4512e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:12:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73b1f0-50b5-4b4f-a2ab-af357ebdd8c9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:35 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:35 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:35 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=61,cinder:DELETE=6 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:12:36 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.772s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:36 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 Jul 11 04:12:36 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:36 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" returned: 0 in 0.700s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:36 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376 Jul 11 04:12:36 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:37 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43.4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" returned: 0 in 0.630s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-4b4bf3ed-6d5d-4a89-a45c-55ac97bf4376" released by "_delete_snapshot" :: held 2.896s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.342s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227e1882-a99a-48b3-ab59-0858bc855ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9', 'volume_size': 1, 'source_volid': 'd61aa057-8e70-4ac2-9f12-d254e4512e43', 'source_volstatus': 'available'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90a19fd-7cbc-417d-826b-98d9a66157db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:37 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Volume volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 (b12123e5-8196-4fb0-b792-40cb2e69b9e9): created successfully Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90a19fd-7cbc-417d-826b-98d9a66157db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:37 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (8410ef37-7b08-4a24-a75d-0ba17ac2605a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:37 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a42745c9-cd3b-4c3b-ab56-2ddcc890be46 tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (4092ac14-7385-4407-8190-e5cbd10b742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1548b8-41cd-4b4f-b494-00e6801bb563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1548b8-41cd-4b4f-b494-00e6801bb563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1429250481',display_name='tempest-VolumesGetTest-Volume-1068216735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8e7156-2b60-43d7-b75c-b9ed4d8172a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:39Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716db7fe-9b3d-4572-a3c0-0694e435baa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716db7fe-9b3d-4572-a3c0-0694e435baa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e133e2c-eff0-4eee-be27-87b8038c82eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e133e2c-eff0-4eee-be27-87b8038c82eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8e7156-2b60-43d7-b75c-b9ed4d8172a5', 'volume_name': 'volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f93bb1-1a32-45f6-b07d-642d17f95e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f93bb1-1a32-45f6-b07d-642d17f95e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4339a4-ede4-4390-9a11-fe02dc568adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:38 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Volume 9e8e7156-2b60-43d7-b75c-b9ed4d8172a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5', 'volume_size': 1} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1429250481',display_name='tempest-VolumesGetTest-Volume-1068216735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8e7156-2b60-43d7-b75c-b9ed4d8172a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:39Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Creating volume 9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:12:38 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:12:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:38 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 1073741824 Jul 11 04:12:38 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:39 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 1073741824" returned: 0 in 0.767s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:39 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 Jul 11 04:12:39 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:40 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4339a4-ede4-4390-9a11-fe02dc568adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fadf11-de67-43d8-abbd-1041ac098774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:40 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Volume volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 (9e8e7156-2b60-43d7-b75c-b9ed4d8172a5): created successfully Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fadf11-de67-43d8-abbd-1041ac098774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (4092ac14-7385-4407-8190-e5cbd10b742b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b61c47d2-38a9-4864-96ee-f836f52b0a39 tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Lock "cinder-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4b6ee-39c1-45f8-aa6a-5a7b96ac1b0e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:41 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 Jul 11 04:12:41 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:41 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5" returned: 0 in 0.756s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:41 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5 Jul 11 04:12:41 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:42 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5" returned: 0 in 0.632s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5" released by "delete_volume" :: held 1.427s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Created reservations ['e5bcfd3d-3564-4785-84cd-a74fe1fa15de', '10ce351e-92f1-4cec-80bf-de54ff91fe5b', '022d0ec4-43bb-4528-876b-8a2be6841e98', 'fb5aaac1-6ab2-42ae-8710-e764c55e0ffa'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:42 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:42 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:43 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.667s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-b12123e5-8196-4fb0-b792-40cb2e69b9e9-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Lock "cinder-b12123e5-8196-4fb0-b792-40cb2e69b9e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5af8046-01c4-476e-9b4b-3fbe0c4818cc tempest-VolumesGetTest-1272785730 None] Lock "cinder-9e8e7156-2b60-43d7-b75c-b9ed4d8172a5-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-b12123e5-8196-4fb0-b792-40cb2e69b9e9" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-b12123e5-8196-4fb0-b792-40cb2e69b9e9" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742edd4-c1bc-40af-ac92-7441a74c4782]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:43 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 Jul 11 04:12:43 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:44 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9" returned: 0 in 0.776s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:44 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9 Jul 11 04:12:44 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:44 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b12123e5-8196-4fb0-b792-40cb2e69b9e9" returned: 0 in 0.636s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-b12123e5-8196-4fb0-b792-40cb2e69b9e9" released by "delete_volume" :: held 1.449s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Created reservations ['41cbc773-103e-43c5-9843-edb87c77337a', 'eb5bdee3-7aca-4a0c-bb20-1795889fe348', '9aa9fd41-3055-49c9-8938-7004678874b9', '5d9a9521-6e1c-48ee-8b4a-0224d07b9e8e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:44 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:44 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-d61aa057-8e70-4ac2-9f12-d254e4512e43-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:45 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.646s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Lock "cinder-d61aa057-8e70-4ac2-9f12-d254e4512e43-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae9abf48-77e6-403f-9848-1df357c80750 tempest-VolumesGetTest-1272785730 None] Lock "cinder-b12123e5-8196-4fb0-b792-40cb2e69b9e9-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-d61aa057-8e70-4ac2-9f12-d254e4512e43" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-d61aa057-8e70-4ac2-9f12-d254e4512e43" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3bc5d3-1e92-4cad-871f-d07620a4af7c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:45 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:45 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:46 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.718s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:46 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43 Jul 11 04:12:46 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:46 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d61aa057-8e70-4ac2-9f12-d254e4512e43" returned: 0 in 0.629s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-d61aa057-8e70-4ac2-9f12-d254e4512e43" released by "delete_volume" :: held 1.398s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=69,cinder:INSERT=32,cinder:UPDATE=82,cinder:DELETE=4 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:12:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Created reservations ['620005ff-092b-4d29-94ea-3ef4afc3a9df', '88879fa5-df34-4e77-97d3-05afa4116f73', 'a399a697-40ed-4cdb-851a-18803ccf8532', 'e1fbba54-6357-499b-b22d-8e473c6643ee'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:47 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:12:47 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:47 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.658s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:12:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:12:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7d6724ef-dd93-4a56-893b-73b5b79c88f0 tempest-VolumesGetTest-1272785730 None] Lock "cinder-d61aa057-8e70-4ac2-9f12-d254e4512e43-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (83bc5174-c763-45dc-84d0-57f3df083a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc70a347-e741-4438-a0cf-3315fff275c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc70a347-e741-4438-a0cf-3315fff275c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1918306040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bd3c89-e4ae-493f-af2f-408b36020e92,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:48Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c95e1a-f3cc-4c43-a9d8-4a5c6645e72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c95e1a-f3cc-4c43-a9d8-4a5c6645e72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6daed7d-ac86-4bb3-bc45-704254256c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6daed7d-ac86-4bb3-bc45-704254256c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60bd3c89-e4ae-493f-af2f-408b36020e92', 'volume_name': 'volume-60bd3c89-e4ae-493f-af2f-408b36020e92', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc54d95-53d1-496a-87f1-9142d8778083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc54d95-53d1-496a-87f1-9142d8778083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e3b30a-8041-4d04-b2a2-e461151a20c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:48 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Volume 60bd3c89-e4ae-493f-af2f-408b36020e92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60bd3c89-e4ae-493f-af2f-408b36020e92', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 11 04:12:48 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Trying to clone 60bd3c89-e4ae-493f-af2f-408b36020e92 from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:12:49 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:12:49 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Image download 20.69 MB at 20.69 MB/s Jul 11 04:12:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da272d1-d5c6-441c-92b8-9f8cb437fe52]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:49 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD Jul 11 04:12:49 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:49 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:49 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 is fetched for user d6c7db7220c042bdbf49feb681a7b11c. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f75942a-2d11-42cb-b3a6-275a75900193]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:50 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD Jul 11 04:12:50 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:50 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1918306040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bd3c89-e4ae-493f-af2f-408b36020e92,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:12:48Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Creating volume 60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:12:50 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:12:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:50 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 1073741824 Jul 11 04:12:50 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:51 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 1073741824" returned: 0 in 0.765s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:51 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:12:51 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:52 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 0 in 0.624s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Attempting download of 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume 60bd3c89-e4ae-493f-af2f-408b36020e92. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf80955-4e53-4746-bf36-ecbbc417e079]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:52 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5 Jul 11 04:12:52 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:52 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5" returned: 0 in 0.694s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:52 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5 Jul 11 04:12:53 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:53 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5" returned: 1 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80fd31bb-c6c3-4f44-9f5f-61edc167e142_avs_g2m5' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:12:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5a0ada-1152-4b85-8f95-d07940677df7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:53 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD Jul 11 04:12:53 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:54 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD" returned: 0 in 0.690s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:54 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] 80fd31bb-c6c3-4f44-9f5f-61edc167e142 was qcow2, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:12:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:54 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:12:54 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:55 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 0 in 1.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:55 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80fd31bb-c6c3-4f44-9f5f-61edc167e142_gh90rvg8devstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:12:55 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Converted 112.00 MB image at 66.02 MB/s Jul 11 04:12:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:56 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 1G Jul 11 04:12:56 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:56 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 1G" returned: 0 in 0.642s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:56 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f81369-7465-43f6-932d-4e525cc603bd]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:12:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:56 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:12:56 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:57 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 0 in 0.688s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:57 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:12:57 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:12:58 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 1 in 0.715s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Downloaded image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 ((None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}])) to volume 60bd3c89-e4ae-493f-af2f-408b36020e92 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Temporary image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 for user d6c7db7220c042bdbf49feb681a7b11c is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Marking volume 60bd3c89-e4ae-493f-af2f-408b36020e92 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Copying metadata from image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 to 60bd3c89-e4ae-493f-af2f-408b36020e92. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Creating volume glance metadata for volume 60bd3c89-e4ae-493f-af2f-408b36020e92 backed by image 80fd31bb-c6c3-4f44-9f5f-61edc167e142 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e3b30a-8041-4d04-b2a2-e461151a20c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bd3c89-e4ae-493f-af2f-408b36020e92', 'volume_size': 1, 'image_id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '61a8d5591c1b4eaa9e418ab85ff819a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '80fd31bb-c6c3-4f44-9f5f-61edc167e142', 'created_at': datetime.datetime(2026, 7, 11, 1, 44, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 1, 44, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80fd31bb-c6c3-4f44-9f5f-61edc167e142/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed4bfae-f9c0-4507-8206-16b6dda580c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Volume volume-60bd3c89-e4ae-493f-af2f-408b36020e92 (60bd3c89-e4ae-493f-af2f-408b36020e92): created successfully Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed4bfae-f9c0-4507-8206-16b6dda580c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (83bc5174-c763-45dc-84d0-57f3df083a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4bc94ced-8897-4b0f-86fc-2c9766dc02fe tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (b76c04aa-00d6-4d71-b869-ebe614934269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48692c88-19de-40f3-834c-b13ac3a2ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48692c88-19de-40f3-834c-b13ac3a2ea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1629750467',display_name='tempest-VolumesGetTest-Volume-2039141999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:13:00Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025a8c55-1c07-4a44-9235-55be9921e1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025a8c55-1c07-4a44-9235-55be9921e1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67683fd0-58b7-424d-a990-f82e980922f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67683fd0-58b7-424d-a990-f82e980922f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579', 'volume_name': 'volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da17a71-d56c-4f58-8ffd-2855c6127003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da17a71-d56c-4f58-8ffd-2855c6127003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6230d6da-e8ab-43ca-87d0-e6c2fb8a8c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:12:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Volume 2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579', 'volume_size': 1} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:12:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1629750467',display_name='tempest-VolumesGetTest-Volume-2039141999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0346dd3de54d999bda8f164a0a958f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:13:00Z,use_quota=True,user_id='d6c7db7220c042bdbf49feb681a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Creating volume 2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:12:59 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:12:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:12:59 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 1073741824 Jul 11 04:12:59 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:00 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 1073741824" returned: 0 in 0.787s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:00 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 Jul 11 04:13:00 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:01 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6230d6da-e8ab-43ca-87d0-e6c2fb8a8c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda2be81-7107-45e5-9406-f26b09cb1bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Volume volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 (2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579): created successfully Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda2be81-7107-45e5-9406-f26b09cb1bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Flow 'volume_create_manager' (b76c04aa-00d6-4d71-b869-ebe614934269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:13:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-60a2dd04-8b96-4b33-a6ca-6447ab3630f8 tempest-VolumesGetTest-1272785730 None] Created volume successfully. Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Lock "cinder-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af6860e-5431-4510-834b-1330eb48e5dd]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:02 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 Jul 11 04:13:02 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:02 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579" returned: 0 in 0.707s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:02 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579 Jul 11 04:13:02 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:03 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579" returned: 0 in 0.609s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579" released by "delete_volume" :: held 1.353s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Created reservations ['e72cb708-f9c7-4a83-ba16-1a0d3f93ce15', '9b6e64a2-d483-4bc2-869a-3968944f525c', '7d4945e4-3b50-4204-a242-9d1bd5e731d4', '14dda818-3bcb-47b0-90b5-0fedba7e9182'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:03 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:13:03 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:03 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.607s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:03 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:13:04 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e9a8e130-5186-4570-bf30-c15cddde740b tempest-VolumesGetTest-1272785730 None] Lock "cinder-2cb0ab47-5a17-46ab-bf8a-a4eb4d3d4579-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-60bd3c89-e4ae-493f-af2f-408b36020e92-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Lock "cinder-60bd3c89-e4ae-493f-af2f-408b36020e92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Acquiring lock "cinder-quobyte-60bd3c89-e4ae-493f-af2f-408b36020e92" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-60bd3c89-e4ae-493f-af2f-408b36020e92" acquired by "delete_volume" :: waited 0.012s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4498288d-18ef-4aba-b46d-36b7c02aac2c]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:04 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:13:04 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:04 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:05 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:13:05 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:05 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 1 in 0.708s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:13:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:05 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92 Jul 11 04:13:05 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:06 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-60bd3c89-e4ae-493f-af2f-408b36020e92" returned: 0 in 0.606s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Lock "cinder-quobyte-60bd3c89-e4ae-493f-af2f-408b36020e92" released by "delete_volume" :: held 2.073s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Created reservations ['75cf6de7-7327-4aea-b52d-9c4b0502dc4f', '6108acda-7eec-4ec0-bad4-e6bd488b17c8', '7771b2ae-c7e9-4f3d-b5de-d75dad0b9cd3', '64ea98a1-8e4f-41b3-b7f2-b4f61cc66611'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:06 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:13:06 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:06 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.602s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:06 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:13:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Deleted volume successfully. Jul 11 04:13:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfbcf11b-535a-472d-a746-e6f700d9a87f tempest-VolumesGetTest-1272785730 None] Lock "cinder-60bd3c89-e4ae-493f-af2f-408b36020e92-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:13:09 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:13:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Flow 'volume_create_manager' (f1ba374f-9a8e-4449-8886-559ec99a2f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:13:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835aabce-9a99-4110-a912-b501083c5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835aabce-9a99-4110-a912-b501083c5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1980363547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23723e8c-ee74-44ca-8ba2-1a28f13f5fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0ea1ae11b341d8827cab5adab63c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:13:10Z,use_quota=True,user_id='1ca02b39ee664e68aa06ca3c0f370646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422d8ed2-b181-488e-8672-13f2db9afabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422d8ed2-b181-488e-8672-13f2db9afabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d59082-10b4-46cb-b174-7ab489c72adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d59082-10b4-46cb-b174-7ab489c72adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23723e8c-ee74-44ca-8ba2-1a28f13f5fd8', 'volume_name': 'volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a592e044-3c7f-47a7-84a8-765fa98ef4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a592e044-3c7f-47a7-84a8-765fa98ef4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b729b62f-ccf1-472c-9355-8bf64f1614e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Volume 23723e8c-ee74-44ca-8ba2-1a28f13f5fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8', 'volume_size': 1} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1980363547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23723e8c-ee74-44ca-8ba2-1a28f13f5fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c0ea1ae11b341d8827cab5adab63c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:13:10Z,use_quota=True,user_id='1ca02b39ee664e68aa06ca3c0f370646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Creating volume 23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:13:10 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:10 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 1073741824 Jul 11 04:13:10 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:10 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 1073741824" returned: 0 in 0.769s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:10 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 Jul 11 04:13:10 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:11 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8" returned: 0 in 0.602s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b729b62f-ccf1-472c-9355-8bf64f1614e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ae67a4-70f1-4207-b58b-33eafc9f055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:11 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Volume volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 (23723e8c-ee74-44ca-8ba2-1a28f13f5fd8): created successfully Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ae67a4-70f1-4207-b58b-33eafc9f055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Flow 'volume_create_manager' (f1ba374f-9a8e-4449-8886-559ec99a2f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:13:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8d59e431-521b-4891-8967-a24722ff9390 tempest-VolumesNegativeTest-8829551 None] Created volume successfully. Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:14 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:13:14 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:14 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:13:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:13:21 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=56,cinder:SELECT=42,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:13:21 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=32,cinder:SELECT=26,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:13:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Acquiring lock "cinder-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Lock "cinder-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Acquiring lock "cinder-quobyte-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Lock "cinder-quobyte-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f9a398-f15d-477f-af64-e6279c55c810]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:40 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 Jul 11 04:13:40 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:40 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8" returned: 0 in 0.736s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:40 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8 Jul 11 04:13:40 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:41 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8" returned: 0 in 0.642s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Lock "cinder-quobyte-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8" released by "delete_volume" :: held 1.418s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Created reservations ['f97ff625-2ae4-4799-937a-810263e1df0d', 'a1677742-acd5-489d-b4bd-2acd9e40d262', 'e2f4a3ba-bd43-42aa-9d25-efbafa715ae0', '1ee8c774-c089-47a4-be9e-2380cbc9c856'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:41 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:13:41 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:42 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.647s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:42 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:13:42 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Deleted volume successfully. Jul 11 04:13:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ba5c63d8-911c-4e97-943d-7c3db3d24b44 tempest-VolumesNegativeTest-8829551 None] Lock "cinder-23723e8c-ee74-44ca-8ba2-1a28f13f5fd8-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Flow 'volume_create_manager' (e635bce4-8405-4b10-a5e8-f5037213a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87db19c9-1156-49f8-bbfe-b3f709989574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87db19c9-1156-49f8-bbfe-b3f709989574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1050080850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928ed554-257e-4420-af80-7baa3fbb00c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5801e208e74b0280a71548ffae079f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:13:44Z,use_quota=True,user_id='6a86787187bc408891d63c3ab86ccaa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f00687b-9e32-4936-89ca-3f1bc3860cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f00687b-9e32-4936-89ca-3f1bc3860cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc70b7f2-6cb1-48b4-9f5f-0454ee75587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc70b7f2-6cb1-48b4-9f5f-0454ee75587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928ed554-257e-4420-af80-7baa3fbb00c3', 'volume_name': 'volume-928ed554-257e-4420-af80-7baa3fbb00c3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b7bc2b-f740-4142-9f4c-36f7bfd8f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b7bc2b-f740-4142-9f4c-36f7bfd8f30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e7d467-0727-4b62-b18d-f1be6051a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:44 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Volume 928ed554-257e-4420-af80-7baa3fbb00c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928ed554-257e-4420-af80-7baa3fbb00c3', 'volume_size': 1} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1050080850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928ed554-257e-4420-af80-7baa3fbb00c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5801e208e74b0280a71548ffae079f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:13:44Z,use_quota=True,user_id='6a86787187bc408891d63c3ab86ccaa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Creating volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:13:44 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:13:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:44 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 1073741824 Jul 11 04:13:44 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:45 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 1073741824" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:45 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 Jul 11 04:13:45 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:45 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3" returned: 0 in 0.613s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e7d467-0727-4b62-b18d-f1be6051a021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928ed554-257e-4420-af80-7baa3fbb00c3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8ee6de-bf04-4dbc-96a0-33bee172dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:13:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Volume volume-928ed554-257e-4420-af80-7baa3fbb00c3 (928ed554-257e-4420-af80-7baa3fbb00c3): created successfully Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8ee6de-bf04-4dbc-96a0-33bee172dacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:13:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Flow 'volume_create_manager' (e635bce4-8405-4b10-a5e8-f5037213a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:13:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5b0fa8b5-8773-472f-b81a-8b508934367e tempest-VolumesSnapshotListTestJSON-888915199 None] Created volume successfully. Jul 11 04:13:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Creating offline snapshot e71a7934-d099-4fd9-b556-31e33f7f3ab7 of volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:13:46 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac093a-996c-4f82-b4b0-0c38e520a334]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:46 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 Jul 11 04:13:46 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:47 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:47 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 1G Jul 11 04:13:47 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:48 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 1G" returned: 0 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:48 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:13:48 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:48 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:48 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 is being set with open permissions: ugo+rw Jul 11 04:13:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:48 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:13:48 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:49 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.615s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:49 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info Jul 11 04:13:49 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:50 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info" returned: 0 in 0.627s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:50 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info is being set with open permissions: ugo+rw Jul 11 04:13:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:50 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info Jul 11 04:13:50 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:50 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.info" returned: 0 in 0.637s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.091s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-93a37f60-0895-4ace-a1d1-c4b38ad9c65d tempest-VolumesSnapshotListTestJSON-888915199 None] Create snapshot completed successfully Jul 11 04:13:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Creating offline snapshot 8b61acbe-4ad6-41be-85f1-f46ddd503220 of volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:13:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[19305498-3ab1-4676-a458-9bf60dcaf9a8]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:52 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:13:52 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:52 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.763s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:13:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:52 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 1G Jul 11 04:13:52 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:53 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 1G" returned: 0 in 0.805s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:53 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:13:53 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:54 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.663s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:54 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 is being set with open permissions: ugo+rw Jul 11 04:13:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:54 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:13:54 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:54 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.638s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.965s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:54 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f12cbdb9-c0b8-4f06-a81b-e715e97eebd7 tempest-VolumesSnapshotListTestJSON-888915199 None] Create snapshot completed successfully Jul 11 04:13:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:13:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:13:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Creating offline snapshot ee8593f9-9d00-4f2a-b1ac-d98870033c01 of volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:13:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[2328ac41-4d5e-4994-86e0-1d258b83066a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:55 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:13:55 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:56 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.711s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:13:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:56 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 1G Jul 11 04:13:56 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:56 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 1G" returned: 0 in 0.811s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:56 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 Jul 11 04:13:56 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:57 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01" returned: 0 in 0.686s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:57 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 is being set with open permissions: ugo+rw Jul 11 04:13:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:57 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 Jul 11 04:13:57 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:58 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01" returned: 0 in 0.635s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:13:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8ef3b8f5-8caa-4ee3-84b6-4c25952879e5 tempest-VolumesSnapshotListTestJSON-888915199 None] Create snapshot completed successfully Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-ee8593f9-9d00-4f2a-b1ac-d98870033c01-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-ee8593f9-9d00-4f2a-b1ac-d98870033c01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-ee8593f9-9d00-4f2a-b1ac-d98870033c01" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-ee8593f9-9d00-4f2a-b1ac-d98870033c01" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Deleting offline snapshot ee8593f9-9d00-4f2a-b1ac-d98870033c01 of volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] snapshot_file for this snap is: volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fda29b0-b03a-4330-99d9-b6784f7d99e7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:13:59 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 Jul 11 04:13:59 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:13:59 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a698b06c-58bd-4dd1-86c8-10b0bdf198bb]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:13:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:00 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:14:00 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:00 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.726s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:14:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:00 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 Jul 11 04:14:00 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:01 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01" returned: 0 in 0.757s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:01 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01 Jul 11 04:14:01 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:02 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.ee8593f9-9d00-4f2a-b1ac-d98870033c01" returned: 0 in 0.614s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-ee8593f9-9d00-4f2a-b1ac-d98870033c01" released by "_delete_snapshot" :: held 2.927s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" released by "delete_snapshot" :: held 2.947s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Created reservations ['8c14eabf-f38f-4c1c-a867-240b05873dcb', 'e31b97a1-9f47-4bc4-ba11-45ce6d2003cf', '3604f895-d51e-4c44-a544-d820d3d17ce9', 'a26dbc23-74cf-45f2-a0e7-f7d7ea7d5820'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:14:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Delete snapshot completed successfully. Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b664ffa3-214c-4a37-bf68-1c1ead000672 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-ee8593f9-9d00-4f2a-b1ac-d98870033c01-delete_snapshot" released by "delete_snapshot" :: held 3.084s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-8b61acbe-4ad6-41be-85f1-f46ddd503220-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-8b61acbe-4ad6-41be-85f1-f46ddd503220-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-8b61acbe-4ad6-41be-85f1-f46ddd503220" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-8b61acbe-4ad6-41be-85f1-f46ddd503220" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Deleting offline snapshot 8b61acbe-4ad6-41be-85f1-f46ddd503220 of volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] snapshot_file for this snap is: volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f9fe12-30ae-4446-a4cf-ae3608185824]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:14:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:02 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:14:02 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:03 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.739s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d7198-e3b4-4a43-b68c-7294e278d004]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:03 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:14:03 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:03 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.818s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:14:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:04 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:14:04 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:04 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:04 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220 Jul 11 04:14:04 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:05 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.8b61acbe-4ad6-41be-85f1-f46ddd503220" returned: 0 in 0.776s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-8b61acbe-4ad6-41be-85f1-f46ddd503220" released by "_delete_snapshot" :: held 3.171s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" released by "delete_snapshot" :: held 3.193s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:05 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Created reservations ['d5329a30-038b-4c89-9537-2338f8c473f6', '0122b4d0-1fe0-4b90-8f75-8242ec25ce1e', 'be09297e-e5d8-41de-af2b-7e758c2b08c1', '09a71e10-9b10-4221-84e3-eb1a9d6ea150'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:14:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Delete snapshot completed successfully. Jul 11 04:14:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bb263a5e-b49a-490c-a86d-d2279917b347 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-8b61acbe-4ad6-41be-85f1-f46ddd503220-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-e71a7934-d099-4fd9-b556-31e33f7f3ab7-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-e71a7934-d099-4fd9-b556-31e33f7f3ab7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-e71a7934-d099-4fd9-b556-31e33f7f3ab7" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-e71a7934-d099-4fd9-b556-31e33f7f3ab7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Deleting offline snapshot e71a7934-d099-4fd9-b556-31e33f7f3ab7 of volume 928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] snapshot_file for this snap is: volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[716663d1-3736-415d-a359-4f73014734b0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:14:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:06 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:14:06 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:07 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928ed554-257e-4420-af80-7baa3fbb00c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:14:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8835368b-5e7d-4fba-980f-eeece0da0a9f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:14:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:07 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 Jul 11 04:14:07 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:08 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3" returned: 0 in 0.703s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:08 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:14:08 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:08 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:08 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7 Jul 11 04:14:08 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:09 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3.e71a7934-d099-4fd9-b556-31e33f7f3ab7" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-e71a7934-d099-4fd9-b556-31e33f7f3ab7" released by "_delete_snapshot" :: held 2.833s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" released by "delete_snapshot" :: held 2.854s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Created reservations ['cb4938f7-37bf-4d98-9fae-f305c40c61e4', '0404fe54-e310-4b0b-9b29-1d614b337e48', '1fc24c63-2162-4e84-a4b5-f1671ae6fba8', '2c752d8e-afa0-42df-9132-81f83f4086c0'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:14:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Delete snapshot completed successfully. Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ea753446-8fb9-41f6-833b-2e5411c10ed6 tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-e71a7934-d099-4fd9-b556-31e33f7f3ab7-delete_snapshot" released by "delete_snapshot" :: held 2.977s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-928ed554-257e-4420-af80-7baa3fbb00c3-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-928ed554-257e-4420-af80-7baa3fbb00c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:14:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:14:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d8c38-47da-4f0a-9c13-d028cada5cf2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:14:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:10 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 Jul 11 04:14:10 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:10 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:10 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3 Jul 11 04:14:10 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:11 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-928ed554-257e-4420-af80-7baa3fbb00c3" returned: 0 in 0.603s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-quobyte-928ed554-257e-4420-af80-7baa3fbb00c3" released by "delete_volume" :: held 1.370s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Created reservations ['12800ee5-3cc0-44d7-a3e4-deb3c321ddd4', '4ba3b35b-4331-454b-8b88-3caa414bd2fb', '56730354-c44a-44e9-aa12-641c1276637f', '2ffde17f-a899-42b7-8605-60cda2c80cdc'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:14:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:11 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:14:11 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:12 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.615s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:14:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Deleted volume successfully. Jul 11 04:14:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-bbc4a522-df4b-45eb-9d02-41b7c92664ea tempest-VolumesSnapshotListTestJSON-888915199 None] Lock "cinder-928ed554-257e-4420-af80-7baa3fbb00c3-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:14 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:14:14 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:14 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.673s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:14:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:14:21 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=37,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:14:22 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Flow 'volume_create_manager' (2ca0d9dc-f440-4df1-9fb3-f5b221c73539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc783ba-373e-4e97-b91c-8a40eb0b0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc783ba-373e-4e97-b91c-8a40eb0b0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-965576838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323c385e-12c5-49c8-afc4-1dd7c0551087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcdfdcdb0b5b4c5fb1033500922dc8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:14:31Z,use_quota=True,user_id='1e371675deb84963a5199ecf21635ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b31f253-7b55-4115-8f97-62506bdf843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b31f253-7b55-4115-8f97-62506bdf843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3b77e3-ddc1-46e9-af9b-e23289653279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3b77e3-ddc1-46e9-af9b-e23289653279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323c385e-12c5-49c8-afc4-1dd7c0551087', 'volume_name': 'volume-323c385e-12c5-49c8-afc4-1dd7c0551087', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5703ad-ca66-48c0-aaa9-73a9cf5a0976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5703ad-ca66-48c0-aaa9-73a9cf5a0976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edfb4b1-51a9-4e59-87b2-05560b47347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Volume 323c385e-12c5-49c8-afc4-1dd7c0551087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323c385e-12c5-49c8-afc4-1dd7c0551087', 'volume_size': 1} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-965576838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323c385e-12c5-49c8-afc4-1dd7c0551087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcdfdcdb0b5b4c5fb1033500922dc8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:14:31Z,use_quota=True,user_id='1e371675deb84963a5199ecf21635ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Creating volume 323c385e-12c5-49c8-afc4-1dd7c0551087 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:14:31 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:31 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 1073741824 Jul 11 04:14:31 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Flow 'volume_create_manager' (dda4836a-1a6f-4b24-ad9b-ecee4e826b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47921cb7-a82b-44eb-8629-bc8b370bfa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47921cb7-a82b-44eb-8629-bc8b370bfa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1411656375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031218dc-33a7-4e86-926a-c68e3f23cef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcdfdcdb0b5b4c5fb1033500922dc8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:14:31Z,use_quota=True,user_id='1e371675deb84963a5199ecf21635ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ae5a6-f454-4057-bef5-ccb291d509c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6ae5a6-f454-4057-bef5-ccb291d509c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768bbadf-d918-435e-9673-27cc563a166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768bbadf-d918-435e-9673-27cc563a166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '031218dc-33a7-4e86-926a-c68e3f23cef3', 'volume_name': 'volume-031218dc-33a7-4e86-926a-c68e3f23cef3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fbeda9-1071-474a-b1d5-e8a0b003c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fbeda9-1071-474a-b1d5-e8a0b003c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d652a9f9-2d62-46c3-bd95-867a631f439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Volume 031218dc-33a7-4e86-926a-c68e3f23cef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-031218dc-33a7-4e86-926a-c68e3f23cef3', 'volume_size': 1} Jul 11 04:14:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:14:32 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 1073741824" returned: 0 in 0.915s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:32 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 Jul 11 04:14:32 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:32 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087" returned: 0 in 0.668s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1411656375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031218dc-33a7-4e86-926a-c68e3f23cef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcdfdcdb0b5b4c5fb1033500922dc8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:14:31Z,use_quota=True,user_id='1e371675deb84963a5199ecf21635ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Creating volume 031218dc-33a7-4e86-926a-c68e3f23cef3 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:14:32 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edfb4b1-51a9-4e59-87b2-05560b47347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323c385e-12c5-49c8-afc4-1dd7c0551087', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:32 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 1073741824 Jul 11 04:14:32 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744b83c7-6124-4ee7-a10c-f3a8731b71b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:32 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Volume volume-323c385e-12c5-49c8-afc4-1dd7c0551087 (323c385e-12c5-49c8-afc4-1dd7c0551087): created successfully Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744b83c7-6124-4ee7-a10c-f3a8731b71b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Flow 'volume_create_manager' (2ca0d9dc-f440-4df1-9fb3-f5b221c73539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:14:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fd4445a5-9b63-4abe-b552-ce1ad95984a3 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Created volume successfully. Jul 11 04:14:33 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 1073741824" returned: 0 in 0.864s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:14:33 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 Jul 11 04:14:33 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:14:34 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3" returned: 0 in 0.652s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d652a9f9-2d62-46c3-bd95-867a631f439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031218dc-33a7-4e86-926a-c68e3f23cef3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fc2455-4e5c-4f50-84b9-8f0f7c92b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:14:34 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Volume volume-031218dc-33a7-4e86-926a-c68e3f23cef3 (031218dc-33a7-4e86-926a-c68e3f23cef3): created successfully Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fc2455-4e5c-4f50-84b9-8f0f7c92b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:14:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Flow 'volume_create_manager' (dda4836a-1a6f-4b24-ad9b-ecee4e826b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:14:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d791834c-bedd-4c1c-957d-20a71db888e2 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Created volume successfully. Jul 11 04:14:44 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=2,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:14:44 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:15:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:15:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:15:12 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53fd3a0-8382-4cb2-89c3-a53addaf0a1b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:15:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:13 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 Jul 11 04:15:13 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:13 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087" returned: 0 in 0.737s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:15:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-323c385e-12c5-49c8-afc4-1dd7c0551087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ada8f77f-5ccc-43de-b69f-f4a5d78f9ae2', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:15:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-604e12ae-0e65-460e-91bf-5f7218ca5ffc req-6c3a2ccf-3818-4b26-8ade-bf5b27004293 tempest-TestServerVolumeAttachmentScenario-1855076461 None] attachment_update completed successfully. Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:14 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:15:14 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:14 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.656s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:15:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:15:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:15:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:15:22 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd765de-be4b-44ac-afb7-4eba7a7464eb]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:15:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:22 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 Jul 11 04:15:22 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:23 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.735s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:15:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-031218dc-33a7-4e86-926a-c68e3f23cef3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f75a657-a37e-4c52-8a39-da81c3346add', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:15:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-506ee2dd-7033-4025-bda1-2d63ca3ffff2 req-9c69267b-383d-4584-b7bb-3b3255eb45df tempest-TestServerVolumeAttachmentScenario-1855076461 None] attachment_update completed successfully. Jul 11 04:15:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-fa44c131-f2c9-4531-aded-72b66cfaaab4 req-d7fad8f5-2a6a-4fe6-9842-5f59afc3e59a tempest-TestServerVolumeAttachmentScenario-1855076461 None] Terminate volume connection completed successfully. Jul 11 04:15:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-fa44c131-f2c9-4531-aded-72b66cfaaab4 req-d7fad8f5-2a6a-4fe6-9842-5f59afc3e59a tempest-TestServerVolumeAttachmentScenario-1855076461 None] Deleting attachment 5f75a657-a37e-4c52-8a39-da81c3346add. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:15:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-860a23bf-c515-439c-a45d-a5e6d1b21542 req-3bddd5ce-b728-4189-b869-90e3c191328e tempest-TestServerVolumeAttachmentScenario-1855076461 None] Terminate volume connection completed successfully. Jul 11 04:15:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-860a23bf-c515-439c-a45d-a5e6d1b21542 req-3bddd5ce-b728-4189-b869-90e3c191328e tempest-TestServerVolumeAttachmentScenario-1855076461 None] Deleting attachment ada8f77f-5ccc-43de-b69f-f4a5d78f9ae2. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "cinder-031218dc-33a7-4e86-926a-c68e3f23cef3-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-031218dc-33a7-4e86-926a-c68e3f23cef3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "cinder-quobyte-031218dc-33a7-4e86-926a-c68e3f23cef3" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-quobyte-031218dc-33a7-4e86-926a-c68e3f23cef3" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f578c-7ad9-45c8-84c4-f893edcebeec]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:15:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:42 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 Jul 11 04:15:42 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:43 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:43 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3 Jul 11 04:15:43 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:44 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-031218dc-33a7-4e86-926a-c68e3f23cef3" returned: 0 in 0.626s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-quobyte-031218dc-33a7-4e86-926a-c68e3f23cef3" released by "delete_volume" :: held 1.384s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Created reservations ['74fac49e-e461-4518-adec-c4dbff5f2c47', '5dd9f99c-ecbd-445b-84bf-665a93a8ce11', 'a0f54833-9bd2-4d87-9e0a-91cdef379616', '83a7ffb0-cc9b-4a51-aa6c-a68263da1ccc'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:44 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:15:44 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:44 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.609s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:15:44 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Deleted volume successfully. Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc651d28-73b4-4ce4-af11-1a7f6f89dcc6 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-031218dc-33a7-4e86-926a-c68e3f23cef3-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "cinder-323c385e-12c5-49c8-afc4-1dd7c0551087-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-323c385e-12c5-49c8-afc4-1dd7c0551087-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "cinder-quobyte-323c385e-12c5-49c8-afc4-1dd7c0551087" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-quobyte-323c385e-12c5-49c8-afc4-1dd7c0551087" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec44fc19-745c-45ee-8b6f-1e1e04713236]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:15:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:44 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 Jul 11 04:15:44 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:45 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087" returned: 0 in 0.716s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:45 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087 Jul 11 04:15:45 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:46 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-323c385e-12c5-49c8-afc4-1dd7c0551087" returned: 0 in 0.624s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-quobyte-323c385e-12c5-49c8-afc4-1dd7c0551087" released by "delete_volume" :: held 1.377s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Created reservations ['047e3c7d-e007-413c-8433-3a7acbca3dff', '6cc8777b-409e-488a-8b23-16dc55a6f708', 'a5b4bb49-4324-48b1-8bcb-ec8b9d4a4c90', '4c37a5a4-c20b-401f-a742-5b49d233bf31'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:15:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:15:46 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:15:46 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:15:47 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 11 04:15:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:15:47 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:15:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Deleted volume successfully. Jul 11 04:15:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cc9318c5-4b22-4734-b257-3125090ae7c9 tempest-TestServerVolumeAttachmentScenario-1855076461 None] Lock "cinder-323c385e-12c5-49c8-afc4-1dd7c0551087-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:15:56 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:15:57 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:16:14 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:16:14 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:16:14 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.696s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:16:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Flow 'volume_create_manager' (0ee7c5b1-2f52-43d3-9ac0-0f214648209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f69f2e8-9d47-410e-9f19-990d880550a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f69f2e8-9d47-410e-9f19-990d880550a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-66317641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e8375c-0e46-4a1a-9c4d-94b98046edee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9181662da1452e98ce793b6afc1c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:16:17Z,use_quota=True,user_id='86d6c731af7a4e2e8dfe81e4599d1cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e06f2f-0ec9-4326-b18e-84fd63d48bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e06f2f-0ec9-4326-b18e-84fd63d48bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d836d40-c08f-4e3c-b468-578c5530d2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d836d40-c08f-4e3c-b468-578c5530d2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e8375c-0e46-4a1a-9c4d-94b98046edee', 'volume_name': 'volume-85e8375c-0e46-4a1a-9c4d-94b98046edee', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567e08d3-3780-4a0d-9ae5-bf26e0dd24ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567e08d3-3780-4a0d-9ae5-bf26e0dd24ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be7191c-f766-418b-abab-c024f5042d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:16:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Volume 85e8375c-0e46-4a1a-9c4d-94b98046edee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e8375c-0e46-4a1a-9c4d-94b98046edee', 'volume_size': 1} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-66317641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e8375c-0e46-4a1a-9c4d-94b98046edee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9181662da1452e98ce793b6afc1c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:16:17Z,use_quota=True,user_id='86d6c731af7a4e2e8dfe81e4599d1cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Creating volume 85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:16:17 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:16:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:16:17 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee 1073741824 Jul 11 04:16:17 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:16:18 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee 1073741824" returned: 0 in 0.854s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:16:18 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:16:18 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:16:18 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.650s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be7191c-f766-418b-abab-c024f5042d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e8375c-0e46-4a1a-9c4d-94b98046edee', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935def04-52bb-4eba-947d-bcc06fb13eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:16:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Volume volume-85e8375c-0e46-4a1a-9c4d-94b98046edee (85e8375c-0e46-4a1a-9c4d-94b98046edee): created successfully Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935def04-52bb-4eba-947d-bcc06fb13eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:16:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Flow 'volume_create_manager' (0ee7c5b1-2f52-43d3-9ac0-0f214648209c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:16:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2465179c-2bc8-49f0-8301-2e49d846f584 tempest-TestStampPattern-1735606899 None] Created volume successfully. Jul 11 04:16:28 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:16:28 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:16:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:16:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:16:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a45043-e8dc-49b3-9803-289e6df1af02]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:16:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:16:57 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:16:57 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:16:58 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 11 04:16:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.744s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:16:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.762s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:16:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-85e8375c-0e46-4a1a-9c4d-94b98046edee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acb601ab-7ccb-4816-be74-8126ea927543', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:16:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-2cea5abc-dc38-4558-8a5c-9eba936975e0 req-95f0a02a-5a1f-4495-b35c-3e18d7d9ec2a tempest-TestStampPattern-1735606899 None] attachment_update completed successfully. Jul 11 04:17:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-077edc17-afea-43ea-a9ed-bb6eca534022 req-41128182-d0af-419a-a908-90af838171db tempest-TestStampPattern-1735606899 None] Terminate volume connection completed successfully. Jul 11 04:17:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-077edc17-afea-43ea-a9ed-bb6eca534022 req-41128182-d0af-419a-a908-90af838171db tempest-TestStampPattern-1735606899 None] Deleting attachment acb601ab-7ccb-4816-be74-8126ea927543. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:17:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:17:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:17:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Creating offline snapshot 3b11b17a-88e2-48fc-aad8-614a7664ce13 of volume 85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:17:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd9cf61-63dc-49e7-9d67-b6a4723c378a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:17:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:08 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:17:08 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:09 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.752s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:09 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 1G Jul 11 04:17:09 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:10 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 1G" returned: 0 in 0.802s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e8375c-0e46-4a1a-9c4d-94b98046edee -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:10 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e8375c-0e46-4a1a-9c4d-94b98046edee -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 Jul 11 04:17:10 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:10 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e8375c-0e46-4a1a-9c4d-94b98046edee -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13" returned: 0 in 0.673s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:10 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 is being set with open permissions: ugo+rw Jul 11 04:17:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:10 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 Jul 11 04:17:10 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:11 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13" returned: 0 in 0.673s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:11 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info Jul 11 04:17:11 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:12 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:12 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info is being set with open permissions: ugo+rw Jul 11 04:17:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:12 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info Jul 11 04:17:12 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:12 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.info" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:17:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-11aef59e-c36f-40d6-aa9a-b2a973cecb7d tempest-TestStampPattern-1735606899 None] Create snapshot completed successfully Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:14 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:17:14 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:14 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:17:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:17:22 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:17:22 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Flow 'volume_create_manager' (180310f6-9e0e-4b6c-aab5-1946e9d57d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d4be3-5a29-41fe-806d-137e1b311392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d4be3-5a29-41fe-806d-137e1b311392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-959901582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353fb953-1fd2-476e-a295-2aa4c826975b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c9181662da1452e98ce793b6afc1c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b11b17a-88e2-48fc-aad8-614a7664ce13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:17:24Z,use_quota=True,user_id='86d6c731af7a4e2e8dfe81e4599d1cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7937d139-b8f8-46b7-9155-6b83fa06e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7937d139-b8f8-46b7-9155-6b83fa06e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2382228-9760-49f9-a141-dd1ff5cd382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2382228-9760-49f9-a141-dd1ff5cd382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '353fb953-1fd2-476e-a295-2aa4c826975b', 'volume_name': 'volume-353fb953-1fd2-476e-a295-2aa4c826975b', 'volume_size': 1, 'snapshot_id': '3b11b17a-88e2-48fc-aad8-614a7664ce13'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cbe47e-60b3-423d-a9c5-c1b43b95fd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cbe47e-60b3-423d-a9c5-c1b43b95fd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0816c543-0835-4091-a513-fdf37cc51f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:17:23 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Volume 353fb953-1fd2-476e-a295-2aa4c826975b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-353fb953-1fd2-476e-a295-2aa4c826975b', 'volume_size': 1, 'snapshot_id': '3b11b17a-88e2-48fc-aad8-614a7664ce13'} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-quobyte-3b11b17a-88e2-48fc-aad8-614a7664ce13-353fb953-1fd2-476e-a295-2aa4c826975b" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-3b11b17a-88e2-48fc-aad8-614a7664ce13-353fb953-1fd2-476e-a295-2aa4c826975b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Creating volume 353fb953-1fd2-476e-a295-2aa4c826975b from snapshot 3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-quobyte-353fb953-1fd2-476e-a295-2aa4c826975b" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-353fb953-1fd2-476e-a295-2aa4c826975b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] snapshot: 3b11b17a-88e2-48fc-aad8-614a7664ce13, volume: 353fb953-1fd2-476e-a295-2aa4c826975b, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c711294-daca-4b49-a2ab-d6421775f1d9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:17:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:23 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 Jul 11 04:17:23 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:24 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13" returned: 0 in 0.860s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e8375c-0e46-4a1a-9c4d-94b98046edee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:17:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:17:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:17:24 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e6e982-c234-4c34-a264-63057a90dd1e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:17:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:24 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:17:24 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:25 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.872s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:25 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:17:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:25 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b Jul 11 04:17:25 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:30 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b" returned: 0 in 4.981s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:30 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a895ca43-cb62-4198-8039-4d94f889685b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:17:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:30 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:17:30 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:31 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 1.136s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:31 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:17:31 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Converted 1024.00 MB image at 205.52 MB/s Jul 11 04:17:31 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b is being set with open permissions: ugo+rw Jul 11 04:17:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:17:31 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b Jul 11 04:17:31 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:17:32 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-353fb953-1fd2-476e-a295-2aa4c826975b" released by "_copy_volume_from_snapshot" :: held 8.678s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-3b11b17a-88e2-48fc-aad8-614a7664ce13-353fb953-1fd2-476e-a295-2aa4c826975b" released by "_create_volume_from_snapshot" :: held 8.710s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.725s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0816c543-0835-4091-a513-fdf37cc51f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353fb953-1fd2-476e-a295-2aa4c826975b', 'volume_size': 1, 'snapshot_id': '3b11b17a-88e2-48fc-aad8-614a7664ce13'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6996af78-770c-4ce2-8bca-a2eb9274809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:17:32 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Volume volume-353fb953-1fd2-476e-a295-2aa4c826975b (353fb953-1fd2-476e-a295-2aa4c826975b): created successfully Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6996af78-770c-4ce2-8bca-a2eb9274809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:17:32 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Flow 'volume_create_manager' (180310f6-9e0e-4b6c-aab5-1946e9d57d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:17:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ab6cf3f5-9854-4acb-ab74-550951c58ff5 tempest-TestStampPattern-1735606899 None] Created volume successfully. Jul 11 04:17:42 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:17:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b55952-d29e-4943-9dcc-33931a2d0ed4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:07 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b Jul 11 04:18:07 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:07 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b" returned: 0 in 0.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:18:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948', 'name': 'volume-353fb953-1fd2-476e-a295-2aa4c826975b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd330215c-95bd-45d2-b624-2b497260d305', 'enforce_multipath': True} {{(pid=87437) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 11 04:18:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-cfbfad65-ae26-4f88-b8a6-100b0470581b req-bd7c0882-95a0-47fe-828c-7f9c3cb8e106 tempest-TestStampPattern-1735606899 None] attachment_update completed successfully. Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:14 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:18:14 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [req-b12a70cc-3818-471c-892c-9ecdf731c9df req-2a9f1de4-f509-4ea8-a2b4-73275ceed86e tempest-TestStampPattern-1735606899 None] Terminate volume connection completed successfully. Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [req-b12a70cc-3818-471c-892c-9ecdf731c9df req-2a9f1de4-f509-4ea8-a2b4-73275ceed86e tempest-TestStampPattern-1735606899 None] Deleting attachment d330215c-95bd-45d2-b624-2b497260d305. {{(pid=87437) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 11 04:18:14 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.666s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:18:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:18:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-353fb953-1fd2-476e-a295-2aa4c826975b-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Lock "cinder-353fb953-1fd2-476e-a295-2aa4c826975b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-quobyte-353fb953-1fd2-476e-a295-2aa4c826975b" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-353fb953-1fd2-476e-a295-2aa4c826975b" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:24 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941fb84-0060-4dfd-997a-b6480a37bcee]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:24 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b Jul 11 04:18:24 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:25 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b" returned: 0 in 0.730s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:25 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b Jul 11 04:18:25 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:26 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-353fb953-1fd2-476e-a295-2aa4c826975b" returned: 0 in 0.622s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-353fb953-1fd2-476e-a295-2aa4c826975b" released by "delete_volume" :: held 1.388s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Created reservations ['8cfcc302-afbe-436b-9650-c6da2b227c02', 'b05004eb-2c13-4778-ba87-49baa027a4ef', 'b4953b9e-e1cd-4403-8ebb-eac5501e06f8', 'd6bef8e5-b712-4380-b5f8-fc1d99203553'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:26 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:18:26 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:26 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.629s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:18:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Deleted volume successfully. Jul 11 04:18:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c88136d1-0076-4237-a0d3-1d20be8a7426 tempest-TestStampPattern-1735606899 None] Lock "cinder-353fb953-1fd2-476e-a295-2aa4c826975b-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-3b11b17a-88e2-48fc-aad8-614a7664ce13-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Lock "cinder-3b11b17a-88e2-48fc-aad8-614a7664ce13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-quobyte-85e8375c-0e46-4a1a-9c4d-94b98046edee" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-85e8375c-0e46-4a1a-9c4d-94b98046edee" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-quobyte-3b11b17a-88e2-48fc-aad8-614a7664ce13" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-3b11b17a-88e2-48fc-aad8-614a7664ce13" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Deleting offline snapshot 3b11b17a-88e2-48fc-aad8-614a7664ce13 of volume 85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] snapshot_file for this snap is: volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[075bb0cf-2cce-48d4-ad1a-c860f7caf662]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:27 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 Jul 11 04:18:27 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:27 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13" returned: 0 in 0.714s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e8375c-0e46-4a1a-9c4d-94b98046edee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94f179d-9fd9-44a9-8534-1b398d1a9176]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:28 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:18:28 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:28 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:28 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 Jul 11 04:18:28 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:29 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13" returned: 0 in 0.690s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:29 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13 Jul 11 04:18:29 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:29 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee.3b11b17a-88e2-48fc-aad8-614a7664ce13" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-3b11b17a-88e2-48fc-aad8-614a7664ce13" released by "_delete_snapshot" :: held 2.830s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-85e8375c-0e46-4a1a-9c4d-94b98046edee" released by "delete_snapshot" :: held 2.851s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:30 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Created reservations ['63f307d0-94b8-454d-a16a-4954d4345c59', '1e324db1-7eb0-4a43-b751-1ec0ae9c37d0', 'e671b298-8390-462e-a581-feea6b686581', '78551061-cf8e-475c-88b0-b0187ac567f4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:18:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Delete snapshot completed successfully. Jul 11 04:18:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d519a646-84c3-4277-bf58-be5bec6f4962 tempest-TestStampPattern-1735606899 None] Lock "cinder-3b11b17a-88e2-48fc-aad8-614a7664ce13-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-85e8375c-0e46-4a1a-9c4d-94b98046edee-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Lock "cinder-85e8375c-0e46-4a1a-9c4d-94b98046edee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Acquiring lock "cinder-quobyte-85e8375c-0e46-4a1a-9c4d-94b98046edee" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:18:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-85e8375c-0e46-4a1a-9c4d-94b98046edee" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:18:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc7b3c-e294-4172-bd07-559b9405b720]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:38 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:18:38 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:39 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.707s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:39 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee Jul 11 04:18:39 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:39 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-85e8375c-0e46-4a1a-9c4d-94b98046edee" returned: 0 in 0.614s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Lock "cinder-quobyte-85e8375c-0e46-4a1a-9c4d-94b98046edee" released by "delete_volume" :: held 1.375s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Created reservations ['d7a77b2b-7262-4940-ae55-91eca56e3648', 'cc4e5a81-34a9-4ba5-8ae5-d6ff2c9f36e9', '8aa6ac7a-6c78-451d-b07f-d12eca90e98c', 'f0156d23-5885-4c2c-b827-a1acfa7a6143'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:18:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:39 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:18:39 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:40 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.604s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:40 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:18:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Deleted volume successfully. Jul 11 04:18:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-698e7b30-9390-490e-af42-1043038287c8 tempest-TestStampPattern-1735606899 None] Lock "cinder-85e8375c-0e46-4a1a-9c4d-94b98046edee-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:18:49 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=7 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:18:50 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Flow 'volume_create_manager' (7ed780a0-0464-4d4b-89da-c6233d4924f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948481c8-8b9b-41b8-8974-d4c45549a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948481c8-8b9b-41b8-8974-d4c45549a472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf950aa-0f86-458f-a2f4-5c56ea8b4a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea233ed9c9c4c5f9466df5453c8979b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:18:53Z,use_quota=True,user_id='1bfec48da0cb4676bf4c591b5699c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49c623c-eaf1-47ba-9c00-cc4b0df7228c),volume_type_id=c49c623c-eaf1-47ba-9c00-cc4b0df7228c)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba27ce8a-0a73-43e0-90bf-f4e03fd7775c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba27ce8a-0a73-43e0-90bf-f4e03fd7775c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823c4339-24c1-4283-b4a0-277f9fabaf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823c4339-24c1-4283-b4a0-277f9fabaf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ebf950aa-0f86-458f-a2f4-5c56ea8b4a98', 'volume_name': 'volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98', 'volume_size': 1, 'image_id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b3bc9abae94a6f73d4e2b141fcf3a8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fea233ed9c9c4c5f9466df5453c8979b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f90c68a1d14ade91adc158b5fb9d96214e01024fc82b65194ce6fb19a7a2de5fd6a618a7f8a62d441473f4043c13cd8c5f38bc98f5667dff2b65098f19e1347', 'id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caca7db-2251-4304-ac62-2114c60a8a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caca7db-2251-4304-ac62-2114c60a8a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f26d15-3bed-43af-a06c-fd1233cf22c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:18:53 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Volume ebf950aa-0f86-458f-a2f4-5c56ea8b4a98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98', 'volume_size': 1, 'image_id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b3bc9abae94a6f73d4e2b141fcf3a8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fea233ed9c9c4c5f9466df5453c8979b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f90c68a1d14ade91adc158b5fb9d96214e01024fc82b65194ce6fb19a7a2de5fd6a618a7f8a62d441473f4043c13cd8c5f38bc98f5667dff2b65098f19e1347', 'id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Trying to clone ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 from image 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:18:53 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5475e464-bd7e-4f61-8628-6ae14b8313c3]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:53 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD Jul 11 04:18:53 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:54 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:54 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD Jul 11 04:18:54 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:54 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD" returned: 1 in 0.672s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Temporary image 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 is fetched for user 1bfec48da0cb4676bf4c591b5699c5dd. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[baec355f-8767-49c1-881c-2fc2f75be934]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:55 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD Jul 11 04:18:55 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:55 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:55 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD Jul 11 04:18:55 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:56 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD" returned: 1 in 0.685s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf950aa-0f86-458f-a2f4-5c56ea8b4a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fea233ed9c9c4c5f9466df5453c8979b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:18:53Z,use_quota=True,user_id='1bfec48da0cb4676bf4c591b5699c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c49c623c-eaf1-47ba-9c00-cc4b0df7228c),volume_type_id=c49c623c-eaf1-47ba-9c00-cc4b0df7228c)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Creating volume ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:18:56 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:18:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:56 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 1073741824 Jul 11 04:18:56 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:57 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 1073741824" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:57 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:18:57 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:57 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 0 in 0.642s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Attempting download of 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'metadata': {}}])) to volume ebf950aa-0f86-458f-a2f4-5c56ea8b4a98. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f409d-902a-4746-ae66-205330f55b2b]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:57 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s Jul 11 04:18:57 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:58 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:58 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s Jul 11 04:18:58 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:59 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s" returned: 1 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_lhsuwq3s' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:18:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[88737f9b-b125-4b3d-bd07-4b758f72ac84]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:18:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:18:59 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD Jul 11 04:18:59 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:18:59 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 11 04:18:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:18:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:00 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD Jul 11 04:19:00 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:00 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD" returned: 1 in 0.681s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:19:00 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 was raw, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:19:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:00 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:19:00 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:01 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 0 in 0.667s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:01 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1_1mb5es4rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:19:01 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:19:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:01 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 1G Jul 11 04:19:01 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:01 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 1G" returned: 0 in 0.631s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aeb3d7-628d-4093-90d1-f39f03ca9f76]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:02 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:19:02 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:02 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 0 in 0.729s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:02 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:19:02 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:03 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 1 in 0.745s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Downloaded image 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 ((None, [{'url': 'file:///opt/stack/data/glance/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'metadata': {}}])) to volume ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Temporary image 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 for user 1bfec48da0cb4676bf4c591b5699c5dd is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Marking volume ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Copying metadata from image 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 to ebf950aa-0f86-458f-a2f4-5c56ea8b4a98. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Creating volume glance metadata for volume ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 backed by image 9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8b3bc9abae94a6f73d4e2b141fcf3a8b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f26d15-3bed-43af-a06c-fd1233cf22c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98', 'volume_size': 1, 'image_id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8b3bc9abae94a6f73d4e2b141fcf3a8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fea233ed9c9c4c5f9466df5453c8979b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f90c68a1d14ade91adc158b5fb9d96214e01024fc82b65194ce6fb19a7a2de5fd6a618a7f8a62d441473f4043c13cd8c5f38bc98f5667dff2b65098f19e1347', 'id': '9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1', 'created_at': datetime.datetime(2026, 7, 11, 2, 18, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 18, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e453e2d-ac3e-44f9-95ce-0cf692cb3ce1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6604f6e2-c10d-4e5a-994b-e27b8946a523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Volume volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 (ebf950aa-0f86-458f-a2f4-5c56ea8b4a98): created successfully Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6604f6e2-c10d-4e5a-994b-e27b8946a523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Flow 'volume_create_manager' (7ed780a0-0464-4d4b-89da-c6233d4924f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c9ae2797-ae09-4288-b929-6835f15ec795 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Created volume successfully. Jul 11 04:19:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Acquiring lock "cinder-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "cinder-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Acquiring lock "cinder-quobyte-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "cinder-quobyte-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d953e8-2515-4d76-9731-314dbb366579]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:04 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:19:04 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:05 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 0 in 0.737s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:05 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:19:05 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:06 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 1 in 0.718s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:19:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:06 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98 Jul 11 04:19:06 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:06 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "cinder-quobyte-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98" released by "delete_volume" :: held 2.146s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:06 devstack cinder-volume[87437]: WARNING cinder.quota [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:19:06 devstack cinder-volume[87437]: WARNING cinder.quota [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 11 04:19:06 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Created reservations ['7d2f4807-cfbd-481b-960a-0cf931dbaadc', 'fda4b13e-2d3a-4263-835c-f7b1dbdc7cbc', 'afa39e2a-610c-471e-a078-bef7da162524', 'bc6bb913-3b45-4cd0-a77e-5cdfdcc5a892'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:07 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:07 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:07 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.621s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Deleted volume successfully. Jul 11 04:19:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2cfea5a6-ed59-4032-b993-a537e7c805f3 tempest-VolumeAndVolumeTypeFromImageTest-678703458 None] Lock "cinder-ebf950aa-0f86-458f-a2f4-5c56ea8b4a98-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Flow 'volume_create_manager' (a43e8e62-2faf-4fbc-abf7-b1f18a9fada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e791daa5-d467-4f8c-abfd-cdb40a80cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e791daa5-d467-4f8c-abfd-cdb40a80cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18896383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbbf340-104b-4af3-9ce8-85eb321c6171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db9de089795416f8ca42f35368d7ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:12Z,use_quota=True,user_id='59205fac484948c791fce0df0bca9bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd341b5-8371-494c-8519-501695d033f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd341b5-8371-494c-8519-501695d033f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3ddda-4f16-413f-b2ff-7af12e1971cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc3ddda-4f16-413f-b2ff-7af12e1971cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbbf340-104b-4af3-9ce8-85eb321c6171', 'volume_name': 'volume-ddbbf340-104b-4af3-9ce8-85eb321c6171', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db760db6-8936-42b1-a22a-1b8ca71879b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db760db6-8936-42b1-a22a-1b8ca71879b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90677d71-0ca5-4ed7-a3e8-ec322b9688fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Volume ddbbf340-104b-4af3-9ce8-85eb321c6171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbbf340-104b-4af3-9ce8-85eb321c6171', 'volume_size': 1} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18896383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbbf340-104b-4af3-9ce8-85eb321c6171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db9de089795416f8ca42f35368d7ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:12Z,use_quota=True,user_id='59205fac484948c791fce0df0bca9bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Creating volume ddbbf340-104b-4af3-9ce8-85eb321c6171 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:12 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:12 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 1073741824 Jul 11 04:19:12 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:13 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 1073741824" returned: 0 in 0.768s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:13 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 Jul 11 04:19:13 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:13 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90677d71-0ca5-4ed7-a3e8-ec322b9688fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbbf340-104b-4af3-9ce8-85eb321c6171', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e06534-cd80-4e21-80a1-07f9feaffda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:14 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Volume volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 (ddbbf340-104b-4af3-9ce8-85eb321c6171): created successfully Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e06534-cd80-4e21-80a1-07f9feaffda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Flow 'volume_create_manager' (a43e8e62-2faf-4fbc-abf7-b1f18a9fada1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c4a5b42a-fc3e-4159-8585-d7e5b1bd044f tempest-ProjectReaderTests-1303528506 None] Created volume successfully. Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:14 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:14 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "cinder-ddbbf340-104b-4af3-9ce8-85eb321c6171-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-ddbbf340-104b-4af3-9ce8-85eb321c6171-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "cinder-quobyte-ddbbf340-104b-4af3-9ce8-85eb321c6171" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-quobyte-ddbbf340-104b-4af3-9ce8-85eb321c6171" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3922175c-c08b-4358-81cd-c22c35f87b41]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:14 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:19:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:19:14 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 Jul 11 04:19:14 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:15 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171" returned: 0 in 0.726s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:15 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171 Jul 11 04:19:15 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:16 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-ddbbf340-104b-4af3-9ce8-85eb321c6171" returned: 0 in 0.599s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-quobyte-ddbbf340-104b-4af3-9ce8-85eb321c6171" released by "delete_volume" :: held 1.361s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Created reservations ['663ab05f-9a84-45c2-808c-01f0807859cf', 'f631271a-ea62-4ee0-845a-444f5d1e6f17', '36f40900-bd1b-4486-ac57-cd3de4f50334', 'b5825eda-c9e7-4676-8d40-0794618f33ce'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:16 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:16 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:16 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.628s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Deleted volume successfully. Jul 11 04:19:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-930cde16-a56f-43fc-bfc4-7c296e2ad9e9 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-ddbbf340-104b-4af3-9ce8-85eb321c6171-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Flow 'volume_create_manager' (83453c35-0f86-42d3-bdb1-043184430e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd10e63-3302-450f-ada8-c9cbbfa7dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd10e63-3302-450f-ada8-c9cbbfa7dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535194303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7a3f7-f027-48f0-90e1-d159506ed903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db9de089795416f8ca42f35368d7ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:17Z,use_quota=True,user_id='59205fac484948c791fce0df0bca9bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236e7c89-7532-45d3-86fc-09bf3e0b8099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236e7c89-7532-45d3-86fc-09bf3e0b8099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eef6fca-9f06-47a9-be05-fa2b4db6c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eef6fca-9f06-47a9-be05-fa2b4db6c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e7a3f7-f027-48f0-90e1-d159506ed903', 'volume_name': 'volume-05e7a3f7-f027-48f0-90e1-d159506ed903', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f34ffa6-c144-4986-a51a-843888ca347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f34ffa6-c144-4986-a51a-843888ca347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a241c2aa-6c28-4cdb-8b28-1b71e86146d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Volume 05e7a3f7-f027-48f0-90e1-d159506ed903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e7a3f7-f027-48f0-90e1-d159506ed903', 'volume_size': 1} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535194303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7a3f7-f027-48f0-90e1-d159506ed903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db9de089795416f8ca42f35368d7ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:17Z,use_quota=True,user_id='59205fac484948c791fce0df0bca9bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Creating volume 05e7a3f7-f027-48f0-90e1-d159506ed903 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:17 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:17 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 1073741824 Jul 11 04:19:17 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:18 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 1073741824" returned: 0 in 0.786s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:18 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 Jul 11 04:19:18 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:18 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903" returned: 0 in 0.613s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a241c2aa-6c28-4cdb-8b28-1b71e86146d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e7a3f7-f027-48f0-90e1-d159506ed903', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20b6aaf-fe38-4167-88bc-a7f31c951996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:18 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Volume volume-05e7a3f7-f027-48f0-90e1-d159506ed903 (05e7a3f7-f027-48f0-90e1-d159506ed903): created successfully Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20b6aaf-fe38-4167-88bc-a7f31c951996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:18 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Flow 'volume_create_manager' (83453c35-0f86-42d3-bdb1-043184430e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-13284373-3b88-4d08-a6e7-62928818bb25 tempest-ProjectReaderTests-1303528506 None] Created volume successfully. Jul 11 04:19:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "cinder-05e7a3f7-f027-48f0-90e1-d159506ed903-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-05e7a3f7-f027-48f0-90e1-d159506ed903-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "cinder-quobyte-05e7a3f7-f027-48f0-90e1-d159506ed903" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-quobyte-05e7a3f7-f027-48f0-90e1-d159506ed903" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaaf7d2-b260-413e-b26b-eb9cb56e5f7b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:19 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 Jul 11 04:19:19 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:20 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903" returned: 0 in 0.731s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:20 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903 Jul 11 04:19:20 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:20 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-05e7a3f7-f027-48f0-90e1-d159506ed903" returned: 0 in 0.603s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-quobyte-05e7a3f7-f027-48f0-90e1-d159506ed903" released by "delete_volume" :: held 1.372s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Created reservations ['11a15098-bea3-4012-97b1-0a0bcd6a769e', '78e0b4aa-5cd7-4138-a51c-b4679881c1b6', '08d8fbce-a631-4fd7-a577-7248f6409f4b', '4003dfc0-c086-4aca-956f-1825b455fe8b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:20 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:20 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:21 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.608s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:21 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Deleted volume successfully. Jul 11 04:19:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-36c8c22a-e7d1-479b-abb4-fa92d4291f06 tempest-ProjectReaderTests-1303528506 None] Lock "cinder-05e7a3f7-f027-48f0-90e1-d159506ed903-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (9cca7a2b-0897-467b-bc6a-0ea0cbcb2306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e584c5-cabc-4f60-b208-7c6e6bab7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e584c5-cabc-4f60-b208-7c6e6bab7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219725745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a866ef-0ea9-4d24-9071-128db5e7388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:25Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb62f08-f980-4463-9311-68c99f2a3811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb62f08-f980-4463-9311-68c99f2a3811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1504941e-b3d8-4ebb-a933-a99495a16fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1504941e-b3d8-4ebb-a933-a99495a16fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a866ef-0ea9-4d24-9071-128db5e7388e', 'volume_name': 'volume-32a866ef-0ea9-4d24-9071-128db5e7388e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4583b005-f3bd-4ad2-9b88-fcbac155950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4583b005-f3bd-4ad2-9b88-fcbac155950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f59904-9d38-4914-9c27-25a3cb6fe049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:24 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Volume 32a866ef-0ea9-4d24-9071-128db5e7388e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a866ef-0ea9-4d24-9071-128db5e7388e', 'volume_size': 1} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219725745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a866ef-0ea9-4d24-9071-128db5e7388e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:25Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Creating volume 32a866ef-0ea9-4d24-9071-128db5e7388e {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:24 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:25 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e 1073741824 Jul 11 04:19:25 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:25 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e 1073741824" returned: 0 in 0.779s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:25 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e Jul 11 04:19:25 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:26 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e" returned: 0 in 0.612s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f59904-9d38-4914-9c27-25a3cb6fe049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a866ef-0ea9-4d24-9071-128db5e7388e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4b66ee-da59-48bc-979f-f97f2f41dd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Volume volume-32a866ef-0ea9-4d24-9071-128db5e7388e (32a866ef-0ea9-4d24-9071-128db5e7388e): created successfully Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4b66ee-da59-48bc-979f-f97f2f41dd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (9cca7a2b-0897-467b-bc6a-0ea0cbcb2306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4754a5ed-c571-4b19-ab39-758ec697296a tempest-ProjectReaderTests-283722109 None] Created volume successfully. Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-32a866ef-0ea9-4d24-9071-128db5e7388e-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Lock "cinder-32a866ef-0ea9-4d24-9071-128db5e7388e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-quobyte-32a866ef-0ea9-4d24-9071-128db5e7388e" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-32a866ef-0ea9-4d24-9071-128db5e7388e" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c25f9-be35-43ff-9b6e-0668025f1a85]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:27 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e Jul 11 04:19:27 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:27 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e" returned: 0 in 0.708s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:27 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e Jul 11 04:19:27 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:28 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-32a866ef-0ea9-4d24-9071-128db5e7388e" returned: 0 in 0.614s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-32a866ef-0ea9-4d24-9071-128db5e7388e" released by "delete_volume" :: held 1.362s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Created reservations ['6771d4c5-c70b-47b8-9c96-05e7c4afb18b', 'dc01ca46-c114-410e-8c42-a1cff706e8fd', '8cd2fa04-c288-4cd0-a1ad-b1bea2f2c15e', '5f493ec7-612c-40d6-956b-688a10bd2970'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:28 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:28 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:29 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.596s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Deleted volume successfully. Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-56975111-02c0-4665-b34e-3b0af05f66eb tempest-ProjectReaderTests-283722109 None] Lock "cinder-32a866ef-0ea9-4d24-9071-128db5e7388e-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (72155283-0059-4603-8887-bdb2689c13e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6250d933-6b4c-4a71-85d9-c463031f3681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6250d933-6b4c-4a71-85d9-c463031f3681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960784236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18458a3-cdb7-4c1e-af54-9f79e3b5adcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:30Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e606c003-843d-477f-82d4-8898cebaa38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e606c003-843d-477f-82d4-8898cebaa38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fbae4c-1469-47c9-b0da-2a5a74b7b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fbae4c-1469-47c9-b0da-2a5a74b7b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18458a3-cdb7-4c1e-af54-9f79e3b5adcc', 'volume_name': 'volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e2889b-6332-4884-9d3a-9d95fa55080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e2889b-6332-4884-9d3a-9d95fa55080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c1fa06-319d-4015-9cac-eb4ee7cdd00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:29 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Volume f18458a3-cdb7-4c1e-af54-9f79e3b5adcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc', 'volume_size': 1} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960784236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18458a3-cdb7-4c1e-af54-9f79e3b5adcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:30Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Creating volume f18458a3-cdb7-4c1e-af54-9f79e3b5adcc {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:29 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:29 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc 1073741824 Jul 11 04:19:29 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:30 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc 1073741824" returned: 0 in 0.773s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:30 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc Jul 11 04:19:30 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:31 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc" returned: 0 in 0.609s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c1fa06-319d-4015-9cac-eb4ee7cdd00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6391dc94-b732-4478-a7eb-b4b39c89ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Volume volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc (f18458a3-cdb7-4c1e-af54-9f79e3b5adcc): created successfully Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6391dc94-b732-4478-a7eb-b4b39c89ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (72155283-0059-4603-8887-bdb2689c13e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5ee12bfb-b39a-4690-b7e2-108b377c9424 tempest-ProjectReaderTests-283722109 None] Created volume successfully. Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Lock "cinder-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-quobyte-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc" acquired by "delete_volume" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb9bb8-7246-4736-a2ca-d451e5a59d3e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:31 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc Jul 11 04:19:31 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:32 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc" returned: 0 in 0.718s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:32 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc Jul 11 04:19:32 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:33 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc" returned: 0 in 0.606s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc" released by "delete_volume" :: held 1.360s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Created reservations ['7850a929-3068-4671-b5ca-4c684a56c197', 'bc4651d6-78ea-4a44-a7f7-21b9b2a21a56', 'f7287d71-ac75-4a3e-8b22-9964f1401db2', 'c7fbfb02-58b9-43ba-8351-b810e6c31bb6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:33 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:33 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:33 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.605s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Deleted volume successfully. Jul 11 04:19:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d3f78d23-d481-4e7d-85b2-0cb2e63c2944 tempest-ProjectReaderTests-283722109 None] Lock "cinder-f18458a3-cdb7-4c1e-af54-9f79e3b5adcc-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (b701e655-527c-4eed-ba29-ed84dc3d6b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764ec853-66b6-4e42-84ad-70784c688ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764ec853-66b6-4e42-84ad-70784c688ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057725127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a540c36c-2daf-41e5-979d-682f3ad4f1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:34Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802c30f3-8c03-40a9-9b01-1698bf548082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802c30f3-8c03-40a9-9b01-1698bf548082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf449db3-1e17-4667-b545-8ec649df123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf449db3-1e17-4667-b545-8ec649df123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a540c36c-2daf-41e5-979d-682f3ad4f1f8', 'volume_name': 'volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3eabf02-85ee-401d-8114-59f0d2d9823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3eabf02-85ee-401d-8114-59f0d2d9823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04722cd-e8b7-47cc-be96-357a92a662d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:34 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Volume a540c36c-2daf-41e5-979d-682f3ad4f1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8', 'volume_size': 1} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057725127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a540c36c-2daf-41e5-979d-682f3ad4f1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:34Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Creating volume a540c36c-2daf-41e5-979d-682f3ad4f1f8 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:34 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:34 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 1073741824 Jul 11 04:19:34 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:35 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 1073741824" returned: 0 in 0.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:35 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 Jul 11 04:19:35 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:35 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8" returned: 0 in 0.606s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04722cd-e8b7-47cc-be96-357a92a662d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9974d36-7241-40f6-a135-2b6a8a87e75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:35 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Volume volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 (a540c36c-2daf-41e5-979d-682f3ad4f1f8): created successfully Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9974d36-7241-40f6-a135-2b6a8a87e75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:35 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (b701e655-527c-4eed-ba29-ed84dc3d6b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-90c582ca-7dcc-4f8e-a35a-cc82d0d4d9a3 tempest-ProjectReaderTests-283722109 None] Created volume successfully. Jul 11 04:19:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-a540c36c-2daf-41e5-979d-682f3ad4f1f8-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Lock "cinder-a540c36c-2daf-41e5-979d-682f3ad4f1f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-quobyte-a540c36c-2daf-41e5-979d-682f3ad4f1f8" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-a540c36c-2daf-41e5-979d-682f3ad4f1f8" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:36 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[372cf4ce-d537-4dbc-b4e5-34f0d7f13ba5]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:36 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 Jul 11 04:19:36 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:37 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8" returned: 0 in 0.706s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:37 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8 Jul 11 04:19:37 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:37 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-a540c36c-2daf-41e5-979d-682f3ad4f1f8" returned: 0 in 0.608s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-a540c36c-2daf-41e5-979d-682f3ad4f1f8" released by "delete_volume" :: held 1.350s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:37 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Created reservations ['ac8fda8b-9484-4b5e-a841-3440f5e0c5ea', '9bf6c1ab-4c91-427f-9ce6-f43efe780e68', '86770f8a-39a3-4145-a9b2-2acbea4bf108', 'e24b26cb-141e-40a7-ae20-798c77466f0e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:38 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:38 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:38 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.612s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:38 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Deleted volume successfully. Jul 11 04:19:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b55f9ab3-9cb5-4c8c-9233-d859a4e596c1 tempest-ProjectReaderTests-283722109 None] Lock "cinder-a540c36c-2daf-41e5-979d-682f3ad4f1f8-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (a067621e-3251-45f6-a9d2-0d88dc817292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cb9e3b-6539-48df-95aa-9171dd21ea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cb9e3b-6539-48df-95aa-9171dd21ea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892200740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92747a17-8051-444b-9229-90a9e690cf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:39Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f31a37-66e3-4ae7-b815-f3ce0b3eae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f31a37-66e3-4ae7-b815-f3ce0b3eae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a470d0c-34dd-4480-8c32-7228815174c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a470d0c-34dd-4480-8c32-7228815174c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92747a17-8051-444b-9229-90a9e690cf7f', 'volume_name': 'volume-92747a17-8051-444b-9229-90a9e690cf7f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9586283f-eb84-491a-a350-fa0c60eec95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9586283f-eb84-491a-a350-fa0c60eec95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e896d4c-749b-431f-a613-3f34858d4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:39 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Volume 92747a17-8051-444b-9229-90a9e690cf7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92747a17-8051-444b-9229-90a9e690cf7f', 'volume_size': 1} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892200740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92747a17-8051-444b-9229-90a9e690cf7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbea829fab414785902fd84606d204b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:39Z,use_quota=True,user_id='4638ba34298c4eeebdcd36f9b39cc1a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Creating volume 92747a17-8051-444b-9229-90a9e690cf7f {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:39 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:39 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f 1073741824 Jul 11 04:19:39 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:39 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f 1073741824" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:40 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f Jul 11 04:19:40 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:40 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f" returned: 0 in 0.620s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e896d4c-749b-431f-a613-3f34858d4a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92747a17-8051-444b-9229-90a9e690cf7f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b467fbf-c1ba-4fd7-be38-b51609f9221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:40 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Volume volume-92747a17-8051-444b-9229-90a9e690cf7f (92747a17-8051-444b-9229-90a9e690cf7f): created successfully Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b467fbf-c1ba-4fd7-be38-b51609f9221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Flow 'volume_create_manager' (a067621e-3251-45f6-a9d2-0d88dc817292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6c04d478-4aaa-4a90-adf4-ba40b3777d96 tempest-ProjectReaderTests-283722109 None] Created volume successfully. Jul 11 04:19:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-92747a17-8051-444b-9229-90a9e690cf7f-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Lock "cinder-92747a17-8051-444b-9229-90a9e690cf7f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Acquiring lock "cinder-quobyte-92747a17-8051-444b-9229-90a9e690cf7f" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:19:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-92747a17-8051-444b-9229-90a9e690cf7f" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:19:41 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[71197987-42f8-43ae-8a37-7f3c37898778]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:19:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:41 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f Jul 11 04:19:41 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:42 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f" returned: 0 in 0.702s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:42 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f Jul 11 04:19:42 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:42 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-92747a17-8051-444b-9229-90a9e690cf7f" returned: 0 in 0.613s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Lock "cinder-quobyte-92747a17-8051-444b-9229-90a9e690cf7f" released by "delete_volume" :: held 1.354s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Created reservations ['2abf2388-3607-4aa6-8616-76a0dd77766b', '73eab220-29b9-41ce-a327-73c510c32861', '657c17a1-d3a3-4681-8a8d-1e84ff07b9e8', '39325e48-7898-445a-9a15-7543e9c8259f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:42 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:19:42 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:43 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.638s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:43 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:19:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Deleted volume successfully. Jul 11 04:19:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ee070ae2-aaa7-4fc3-85f7-24890832d06b tempest-ProjectReaderTests-283722109 None] Lock "cinder-92747a17-8051-444b-9229-90a9e690cf7f-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:19:52 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=52,cinder:UPDATE=79,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:19:53 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=79,cinder:SELECT=59,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (d2c068c0-ae6b-4a79-aec2-09d53cbd323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7baf7bf-976e-4259-a914-8dcc5f158761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7baf7bf-976e-4259-a914-8dcc5f158761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1638563230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab92edc-3e94-4322-af28-8b70b1ab2a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:55Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b91464d-5274-48ed-9684-b36b6a2691cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b91464d-5274-48ed-9684-b36b6a2691cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87359ef1-dfff-4815-91d0-5e5bfe4eb34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87359ef1-dfff-4815-91d0-5e5bfe4eb34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab92edc-3e94-4322-af28-8b70b1ab2a52', 'volume_name': 'volume-eab92edc-3e94-4322-af28-8b70b1ab2a52', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7d45cd-7fe4-40df-9a1e-78f1bf70e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7d45cd-7fe4-40df-9a1e-78f1bf70e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d97e4-7aeb-4e2f-ad5d-ea3373cf8a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume eab92edc-3e94-4322-af28-8b70b1ab2a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab92edc-3e94-4322-af28-8b70b1ab2a52', 'volume_size': 1} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1638563230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab92edc-3e94-4322-af28-8b70b1ab2a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:55Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Creating volume eab92edc-3e94-4322-af28-8b70b1ab2a52 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:55 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:55 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 1073741824 Jul 11 04:19:55 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (bf8525b7-2321-4274-aa0b-bdcfef3c03dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0455f1f3-82c0-4035-90c1-209fc75a9dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0455f1f3-82c0-4035-90c1-209fc75a9dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439178107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c19c3d0-8466-47f3-a48e-df9533a8fd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:55Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36c28c0-98fa-43fa-b75b-87dd40d67f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36c28c0-98fa-43fa-b75b-87dd40d67f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375d8f43-cdfe-46cf-b232-68c0ac3c413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375d8f43-cdfe-46cf-b232-68c0ac3c413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c19c3d0-8466-47f3-a48e-df9533a8fd5a', 'volume_name': 'volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e20839-e0a2-4437-b3cc-f40741c8459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e20839-e0a2-4437-b3cc-f40741c8459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a36f18-0f16-4451-8e70-005f86ba3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Volume 2c19c3d0-8466-47f3-a48e-df9533a8fd5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a', 'volume_size': 1} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:55 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (96513931-2f32-4ac0-8e46-38aba91a1028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7182c7-7c21-4e1c-8da2-38ec0950e21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7182c7-7c21-4e1c-8da2-38ec0950e21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1525932024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a0ee29-8d40-4af8-a7e1-d76e7eafe685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:56Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a6689e-0efc-4648-a569-b701b7a8452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a6689e-0efc-4648-a569-b701b7a8452a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21014bae-0730-4950-aaaa-182b1378e690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21014bae-0730-4950-aaaa-182b1378e690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a0ee29-8d40-4af8-a7e1-d76e7eafe685', 'volume_name': 'volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d744371-c96f-4dd4-a7ea-6be7a0791667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d744371-c96f-4dd4-a7ea-6be7a0791667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f2705a-5871-4887-a665-0f24063ad738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Volume d4a0ee29-8d40-4af8-a7e1-d76e7eafe685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685', 'volume_size': 1} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (eea016df-2264-487d-ad23-4ba3dca9fc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f26f19-ec6c-48c8-9094-71be7b1da1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f26f19-ec6c-48c8-9094-71be7b1da1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1517456077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:56Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c089130-d8de-4e05-8da0-92cc797c0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c089130-d8de-4e05-8da0-92cc797c0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d94c81-f1e1-490e-b6d0-cf8bce33c831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d94c81-f1e1-490e-b6d0-cf8bce33c831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b', 'volume_name': 'volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b5015d-9d9d-4b33-94de-e1f88beb3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b5015d-9d9d-4b33-94de-e1f88beb3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3872cf-b9e9-4f3d-9404-de607860ce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Volume c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b', 'volume_size': 1} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:56 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 1073741824" returned: 0 in 1.306s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:56 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 Jul 11 04:19:56 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:56 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (68ca09a7-d495-4c23-85ab-2bb3891f76d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7226990-06af-4d32-aca5-81c00c71a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7226990-06af-4d32-aca5-81c00c71a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740213905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f6f91b-9218-4136-994f-c35a60643daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:57Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3109f81-fb0a-4b04-bd22-d556ae07edaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3109f81-fb0a-4b04-bd22-d556ae07edaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe4b4f3-d5b4-42be-8b28-1f691c6ff270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe4b4f3-d5b4-42be-8b28-1f691c6ff270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f6f91b-9218-4136-994f-c35a60643daa', 'volume_name': 'volume-d9f6f91b-9218-4136-994f-c35a60643daa', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051bb6a7-6b2b-45c8-8a9e-b08c09a5101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051bb6a7-6b2b-45c8-8a9e-b08c09a5101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adbb437-0c29-4dfc-97e5-0e111170025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Volume d9f6f91b-9218-4136-994f-c35a60643daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f6f91b-9218-4136-994f-c35a60643daa', 'volume_size': 1} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (45e882c7-3f93-443a-8436-015560e71c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8011628-a720-47b0-9358-4fcc2d84a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8011628-a720-47b0-9358-4fcc2d84a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-510580155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d984515c-2958-45ea-aa6e-215fc8e3638e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:57Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbbba8b-389c-40e6-966c-338fc2bf62ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbbba8b-389c-40e6-966c-338fc2bf62ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20054c39-73b5-4cbe-8b26-eda8f1bd98b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20054c39-73b5-4cbe-8b26-eda8f1bd98b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd984515c-2958-45ea-aa6e-215fc8e3638e', 'volume_name': 'volume-d984515c-2958-45ea-aa6e-215fc8e3638e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f44e26-eef2-4846-87d5-c0ee52c717ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f44e26-eef2-4846-87d5-c0ee52c717ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caea6b5-1879-41e7-b6c1-dd0fa9d86628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Volume d984515c-2958-45ea-aa6e-215fc8e3638e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d984515c-2958-45ea-aa6e-215fc8e3638e', 'volume_size': 1} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:57 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52" returned: 0 in 1.016s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.384s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.149s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439178107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c19c3d0-8466-47f3-a48e-df9533a8fd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:55Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Creating volume 2c19c3d0-8466-47f3-a48e-df9533a8fd5a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:19:57 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:57 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a 1073741824 Jul 11 04:19:57 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d97e4-7aeb-4e2f-ad5d-ea3373cf8a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab92edc-3e94-4322-af28-8b70b1ab2a52', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6a7db6-6b0a-4b3e-8381-63ddc66bc508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 (eab92edc-3e94-4322-af28-8b70b1ab2a52): created successfully Jul 11 04:19:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6a7db6-6b0a-4b3e-8381-63ddc66bc508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (d2c068c0-ae6b-4a79-aec2-09d53cbd323e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e778173d-1578-4816-aed3-4bd835123ee1 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created volume successfully. Jul 11 04:19:58 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Flow 'volume_create_manager' (9ba0240f-b3e7-4b4f-b329-a58f960a51a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d80ae8-b71e-44a1-a8a6-c37decaf78b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a 1073741824" returned: 0 in 1.113s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d80ae8-b71e-44a1-a8a6-c37decaf78b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba7b434-a135-4799-846b-39fadc958908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917abcab8de44caf815eb3f865209189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:59Z,use_quota=True,user_id='f49b4743ff084f7ba7752df81da65ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db36d264-563f-4e3a-aa53-0c709522aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db36d264-563f-4e3a-aa53-0c709522aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e8783-b2dd-4085-a5be-0ee19c349de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:19:59 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a Jul 11 04:19:59 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (d9466aad-814f-4bb5-90d7-0d25aa3562ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8185f380-ac2b-4577-9550-a628ca0a4f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8185f380-ac2b-4577-9550-a628ca0a4f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-30153286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477ef67e-a983-485a-bd20-ecd0543168ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:59Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b25c366-b36c-4182-bbcf-3b516a7a35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b25c366-b36c-4182-bbcf-3b516a7a35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63394526-2ba3-4e22-b3c5-8c5f6f72f7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63394526-2ba3-4e22-b3c5-8c5f6f72f7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477ef67e-a983-485a-bd20-ecd0543168ba', 'volume_name': 'volume-477ef67e-a983-485a-bd20-ecd0543168ba', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6290e100-775c-49ec-a8b3-19e798c94355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6290e100-775c-49ec-a8b3-19e798c94355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f1cef2-e8df-42c9-856d-591e2c10af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume 477ef67e-a983-485a-bd20-ecd0543168ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477ef67e-a983-485a-bd20-ecd0543168ba', 'volume_size': 1} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e8783-b2dd-4085-a5be-0ee19c349de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ba7b434-a135-4799-846b-39fadc958908', 'volume_name': 'volume-2ba7b434-a135-4799-846b-39fadc958908', 'volume_size': 1, 'image_id': '692d7db8-3753-4e44-a41c-299705cacf23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/692d7db8-3753-4e44-a41c-299705cacf23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a7f85a8dbdb8ab7c38512c67836f79b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '917abcab8de44caf815eb3f865209189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f658c7747f09a43287e29de6daa176f2f437ab1b7d605a16a62c17048bd9d342712787cb0ddb431a62d8c034479a1b4cb642d2c4c42eae9cf3ecf652acea7d10', 'id': '692d7db8-3753-4e44-a41c-299705cacf23', 'created_at': datetime.datetime(2026, 7, 11, 2, 19, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 19, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/692d7db8-3753-4e44-a41c-299705cacf23/file', 'properties': {}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc9d7a8-9aca-4aa3-a783-d62df0a79c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc9d7a8-9aca-4aa3-a783-d62df0a79c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f7a3ff-9801-4d6e-bfc2-a560d4a2b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Volume 2ba7b434-a135-4799-846b-39fadc958908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ba7b434-a135-4799-846b-39fadc958908', 'volume_size': 1, 'image_id': '692d7db8-3753-4e44-a41c-299705cacf23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/692d7db8-3753-4e44-a41c-299705cacf23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a7f85a8dbdb8ab7c38512c67836f79b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '917abcab8de44caf815eb3f865209189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f658c7747f09a43287e29de6daa176f2f437ab1b7d605a16a62c17048bd9d342712787cb0ddb431a62d8c034479a1b4cb642d2c4c42eae9cf3ecf652acea7d10', 'id': '692d7db8-3753-4e44-a41c-299705cacf23', 'created_at': datetime.datetime(2026, 7, 11, 2, 19, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 19, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/692d7db8-3753-4e44-a41c-299705cacf23/file', 'properties': {}}, 'image_service': } Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Trying to clone 2ba7b434-a135-4799-846b-39fadc958908 from image 692d7db8-3753-4e44-a41c-299705cacf23 at location (None, [{'url': 'file:///opt/stack/data/glance/images/692d7db8-3753-4e44-a41c-299705cacf23', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (2c7494ab-a366-4889-af82-ca5ea163ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499b1fca-0df8-4456-9768-b116202d7448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499b1fca-0df8-4456-9768-b116202d7448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883142032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:00Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bdc89d-d5a2-4588-b5d3-3099c2696310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bdc89d-d5a2-4588-b5d3-3099c2696310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78346a5e-8b84-4318-8fc0-7c96164c70ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78346a5e-8b84-4318-8fc0-7c96164c70ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a', 'volume_name': 'volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f8af76-1992-417a-8523-49bf4e716511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f8af76-1992-417a-8523-49bf4e716511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8203600f-76ef-44b3-854b-7398ee4a7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:19:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume 5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a', 'volume_size': 1} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:19:59 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:19:59 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4bd78d-636a-4d97-9805-751b08443bb5]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:00 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD Jul 11 04:20:00 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:00 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a" returned: 0 in 1.071s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.372s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.220s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1525932024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a0ee29-8d40-4af8-a7e1-d76e7eafe685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:56Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Creating volume d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:00 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a36f18-0f16-4451-8e70-005f86ba3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:00 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 1073741824 Jul 11 04:20:00 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1889e619-4db6-4342-aac1-5633b5262278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Volume volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a (2c19c3d0-8466-47f3-a48e-df9533a8fd5a): created successfully Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1889e619-4db6-4342-aac1-5633b5262278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (bf8525b7-2321-4274-aa0b-bdcfef3c03dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:00 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-76c79833-d178-4020-9ece-5dcdab6d5eaa tempest-CreateVolumesFromImageTest-1296604708 None] Created volume successfully. Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (87f8f2d5-4d50-4648-b65f-69cd6d85a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbd14db-75a1-44c4-801d-02c3dae4191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cbd14db-75a1-44c4-801d-02c3dae4191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177449379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1bf191-f1e8-42d2-8577-fa045915c233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:01Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35249d64-7d88-4f81-a626-1fa76df6cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35249d64-7d88-4f81-a626-1fa76df6cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57da7d5-018a-44ac-be46-28bff4192402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57da7d5-018a-44ac-be46-28bff4192402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1bf191-f1e8-42d2-8577-fa045915c233', 'volume_name': 'volume-af1bf191-f1e8-42d2-8577-fa045915c233', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9c5fc3-0b06-4be5-bcf2-600baa09d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9c5fc3-0b06-4be5-bcf2-600baa09d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a32bf79-8219-43ce-93ca-c37f0790add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume af1bf191-f1e8-42d2-8577-fa045915c233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1bf191-f1e8-42d2-8577-fa045915c233', 'volume_size': 1} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Flow 'volume_create_manager' (f4cd2136-29e8-4d8e-856b-732e93312022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269c5fb8-c13a-4262-aa3d-94e0b6aa0499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269c5fb8-c13a-4262-aa3d-94e0b6aa0499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58c6379-abca-4a0c-a732-5a29ad3e2f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36c5095ca174e8fb1fade808c02d157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:01Z,use_quota=True,user_id='36d7a2025d844ea69ac847ed56bf278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643e8506-7a5d-46b2-8823-03b0753a72a4),volume_type_id=643e8506-7a5d-46b2-8823-03b0753a72a4)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda94ec0-0b17-4df6-ae0b-9ae93da9e577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda94ec0-0b17-4df6-ae0b-9ae93da9e577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fcce4-c72e-4f5b-a419-bcf91d0f41cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.image.glance [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Creating Keystone auth plugin from conf {{(pid=87437) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:01 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (5f2ffc00-ca6c-41fd-8dd6-0149cd5ee01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8771977-af46-4b49-a6b5-ef095ef2a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD" returned: 0 in 1.188s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8771977-af46-4b49-a6b5-ef095ef2a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496864243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c4d736-3f52-4c02-a525-c82b8ffa42a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:01Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d97ce81-a34a-4a68-a407-92df397627be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d97ce81-a34a-4a68-a407-92df397627be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58770c4-4e44-4df9-8be2-a12750c1365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58770c4-4e44-4df9-8be2-a12750c1365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c4d736-3f52-4c02-a525-c82b8ffa42a6', 'volume_name': 'volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae619e3c-d4a2-48b9-9008-bfba45f927c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae619e3c-d4a2-48b9-9008-bfba45f927c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199a2ae7-951c-4054-bf48-d6afb17570c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume 72c4d736-3f52-4c02-a525-c82b8ffa42a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6', 'volume_size': 1} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:01 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD Jul 11 04:20:01 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0fcce4-c72e-4f5b-a419-bcf91d0f41cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c58c6379-abca-4a0c-a732-5a29ad3e2f59', 'volume_name': 'volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59', 'volume_size': 1, 'image_id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6c5323dcdbb70ca8e1816515a1e44d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a36c5095ca174e8fb1fade808c02d157', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7560100b94c3206dc87565cb0925c3bd6a8cfee7a0e6f5ce1b57d9e6caa4b048216f8858b923f92115b3cbb9edc93f6cc6f720593d3a718adb6d036da53f58d', 'id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'created_at': datetime.datetime(2026, 7, 11, 2, 19, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873d417f-7412-49de-b88e-29b49cd6ce0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873d417f-7412-49de-b88e-29b49cd6ce0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a55ea6-74fd-472a-aa6c-fde192d71b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Volume c58c6379-abca-4a0c-a732-5a29ad3e2f59: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59', 'volume_size': 1, 'image_id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6c5323dcdbb70ca8e1816515a1e44d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a36c5095ca174e8fb1fade808c02d157', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7560100b94c3206dc87565cb0925c3bd6a8cfee7a0e6f5ce1b57d9e6caa4b048216f8858b923f92115b3cbb9edc93f6cc6f720593d3a718adb6d036da53f58d', 'id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'created_at': datetime.datetime(2026, 7, 11, 2, 19, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Trying to clone c58c6379-abca-4a0c-a732-5a29ad3e2f59 from image dd1bc35d-33e6-4b70-abc8-24f0334cbfda at location (None, [{'url': 'file:///opt/stack/data/glance/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'metadata': {}}]). {{(pid=87437) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 11 04:20:01 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 1073741824" returned: 0 in 1.391s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:734}} Jul 11 04:20:01 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Image download 0.00 MB at 0.00 MB/s Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (78ca686b-18a7-473e-b09a-f76a8e23cf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e71a6f6-c151-4154-9f61-8a08fa42bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[972e8fda-4114-4724-9917-7fca3a668a11]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:01 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 Jul 11 04:20:01 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e71a6f6-c151-4154-9f61-8a08fa42bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784163535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4bf5d1-36fa-467c-a3af-0b5b587501fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:02Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc406a7-5d3d-4290-a58f-61593a4a0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc406a7-5d3d-4290-a58f-61593a4a0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f71c62-18c2-4c06-831d-3eee97242829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f71c62-18c2-4c06-831d-3eee97242829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4bf5d1-36fa-467c-a3af-0b5b587501fb', 'volume_name': 'volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9376aaf5-f614-470c-853e-a24d89015b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9376aaf5-f614-470c-853e-a24d89015b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64720726-8eb7-482b-8ea3-de926a5716c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume 6a4bf5d1-36fa-467c-a3af-0b5b587501fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb', 'volume_size': 1} Jul 11 04:20:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:01 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD Jul 11 04:20:01 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:02 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD" returned: 1 in 1.020s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Temporary image 692d7db8-3753-4e44-a41c-299705cacf23 is fetched for user f49b4743ff084f7ba7752df81da65ec2. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db5da3-f967-489a-83de-a3f0ecd1abf2]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:02 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD Jul 11 04:20:02 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:02 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.970s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1517456077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:56Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Creating volume c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:02 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:02 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b 1073741824 Jul 11 04:20:02 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f2705a-5871-4887-a665-0f24063ad738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bba1a61-cd99-42d5-a630-0f112c1b2281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:02 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Volume volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 (d4a0ee29-8d40-4af8-a7e1-d76e7eafe685): created successfully Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bba1a61-cd99-42d5-a630-0f112c1b2281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (96513931-2f32-4ac0-8e46-38aba91a1028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:02 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4bb462e9-65a5-4594-b873-57d95ca837ee tempest-CreateVolumesFromImageTest-1296604708 None] Created volume successfully. Jul 11 04:20:02 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD Jul 11 04:20:02 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:03 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:03 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD Jul 11 04:20:03 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:03 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Temporary image dd1bc35d-33e6-4b70-abc8-24f0334cbfda is fetched for user 36d7a2025d844ea69ac847ed56bf278a. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1433}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80c0d79-2290-49c2-af36-d0cbfff7a80a]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:03 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b 1073741824" returned: 0 in 1.041s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:03 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD Jul 11 04:20:03 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:03 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b Jul 11 04:20:03 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:03 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD" returned: 1 in 0.867s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:04 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:04 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD Jul 11 04:20:04 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:04 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b" returned: 0 in 0.742s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.236s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740213905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f6f91b-9218-4136-994f-c35a60643daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:57Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Creating volume d9f6f91b-9218-4136-994f-c35a60643daa {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:04 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3872cf-b9e9-4f3d-9404-de607860ce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:04 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa 1073741824 Jul 11 04:20:04 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccabb80-a9b9-411c-9c46-bfdbd669119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Volume volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b (c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b): created successfully Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccabb80-a9b9-411c-9c46-bfdbd669119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (eea016df-2264-487d-ad23-4ba3dca9fc6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:04 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-be79e225-b1d5-4e62-aab1-f2903b1bad1d tempest-CreateVolumesFromImageTest-1296604708 None] Created volume successfully. Jul 11 04:20:05 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD" returned: 1 in 0.778s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:05 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa 1073741824" returned: 0 in 0.896s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:05 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa Jul 11 04:20:05 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:05 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa" returned: 0 in 0.630s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.489s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-510580155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d984515c-2958-45ea-aa6e-215fc8e3638e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fc1a91633e46f0b03b7f4e053c0329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:57Z,use_quota=True,user_id='5e21222cbfc143879c30661a1e4f7bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Creating volume d984515c-2958-45ea-aa6e-215fc8e3638e {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:05 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adbb437-0c29-4dfc-97e5-0e111170025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f6f91b-9218-4136-994f-c35a60643daa', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:06 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e 1073741824 Jul 11 04:20:06 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96417de-506b-400e-aa2f-a56e0483b986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:06 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Volume volume-d9f6f91b-9218-4136-994f-c35a60643daa (d9f6f91b-9218-4136-994f-c35a60643daa): created successfully Jul 11 04:20:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96417de-506b-400e-aa2f-a56e0483b986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (68ca09a7-d495-4c23-85ab-2bb3891f76d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5bc80712-96de-45bf-9021-d3ae23e460d1 tempest-CreateVolumesFromImageTest-1296604708 None] Created volume successfully. Jul 11 04:20:06 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e 1073741824" returned: 0 in 0.841s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:06 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e Jul 11 04:20:06 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:07 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e" returned: 0 in 0.641s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.987s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-30153286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477ef67e-a983-485a-bd20-ecd0543168ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:59Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Creating volume 477ef67e-a983-485a-bd20-ecd0543168ba {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:07 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:07 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba 1073741824 Jul 11 04:20:07 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caea6b5-1879-41e7-b6c1-dd0fa9d86628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d984515c-2958-45ea-aa6e-215fc8e3638e', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd3d198-e058-4bd5-8651-694dcd72fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Volume volume-d984515c-2958-45ea-aa6e-215fc8e3638e (d984515c-2958-45ea-aa6e-215fc8e3638e): created successfully Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd3d198-e058-4bd5-8651-694dcd72fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Flow 'volume_create_manager' (45e882c7-3f93-443a-8436-015560e71c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dc9227ea-1b37-460d-8503-764fdcbc67cb tempest-CreateVolumesFromImageTest-1296604708 None] Created volume successfully. Jul 11 04:20:08 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba 1073741824" returned: 0 in 0.855s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:08 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba Jul 11 04:20:08 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-d984515c-2958-45ea-aa6e-215fc8e3638e-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-d984515c-2958-45ea-aa6e-215fc8e3638e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-quobyte-d984515c-2958-45ea-aa6e-215fc8e3638e" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-d984515c-2958-45ea-aa6e-215fc8e3638e" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe107a5-a061-4330-88fe-da19fb5e2350]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:08 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e Jul 11 04:20:08 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:09 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.253s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883142032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:00Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Creating volume 5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:09 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f1cef2-e8df-42c9-856d-591e2c10af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477ef67e-a983-485a-bd20-ecd0543168ba', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:09 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a 1073741824 Jul 11 04:20:09 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6437ca5-71e8-4079-92c4-b5b138257741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume volume-477ef67e-a983-485a-bd20-ecd0543168ba (477ef67e-a983-485a-bd20-ecd0543168ba): created successfully Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6437ca5-71e8-4079-92c4-b5b138257741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (d9466aad-814f-4bb5-90d7-0d25aa3562ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0f9e491a-e37d-414c-be38-7cb6367568a0 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created volume successfully. Jul 11 04:20:09 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e" returned: 0 in 0.809s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:09 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e Jul 11 04:20:09 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:10 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d984515c-2958-45ea-aa6e-215fc8e3638e" returned: 0 in 0.733s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-d984515c-2958-45ea-aa6e-215fc8e3638e" released by "delete_volume" :: held 1.591s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:10 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a 1073741824" returned: 0 in 0.942s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Created reservations ['746ab875-2c00-4b7e-a2c2-6c8901876c1f', 'c642be49-5350-4fa1-a2da-df2d1a1cb17e', '3f4087c5-2305-41e0-adee-bb588635dab2', '6b8dc480-4847-4e4d-bacb-51e2c3660f61'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:10 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a Jul 11 04:20:10 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:10 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:10 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-d9f6f91b-9218-4136-994f-c35a60643daa-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-d9f6f91b-9218-4136-994f-c35a60643daa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-quobyte-d9f6f91b-9218-4136-994f-c35a60643daa" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-d9f6f91b-9218-4136-994f-c35a60643daa" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a76c75-b87f-4997-8a2b-c2d9f97589c9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:10 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a" returned: 0 in 0.704s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.003s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1177449379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1bf191-f1e8-42d2-8577-fa045915c233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:01Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Creating volume af1bf191-f1e8-42d2-8577-fa045915c233 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:10 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:10 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa Jul 11 04:20:10 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8203600f-76ef-44b3-854b-7398ee4a7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:10 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 1073741824 Jul 11 04:20:10 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f97a683-ca9d-4db6-a871-c2a26e3b6bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:11 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a (5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a): created successfully Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f97a683-ca9d-4db6-a871-c2a26e3b6bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (2c7494ab-a366-4889-af82-ca5ea163ac68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a9d6053b-e949-4694-95b9-f77cf256913c tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created volume successfully. Jul 11 04:20:11 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.752s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Deleted volume successfully. Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a2a4ac53-3275-4197-8dfe-46c201d4c3b8 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-d984515c-2958-45ea-aa6e-215fc8e3638e-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:11 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa" returned: 0 in 0.790s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:11 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa Jul 11 04:20:11 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:11 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 1073741824" returned: 0 in 0.897s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:11 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 Jul 11 04:20:11 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:12 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d9f6f91b-9218-4136-994f-c35a60643daa" returned: 0 in 0.636s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-d9f6f91b-9218-4136-994f-c35a60643daa" released by "delete_volume" :: held 1.468s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Created reservations ['1ee61fec-74ee-490e-8d2f-d3188f89e44f', '333ee683-4374-4d9c-9a58-df70a3b925c3', '7f6e0748-10b3-4c13-976b-c716a1c7491c', 'c9fbbdb3-bf8b-45d6-bbaf-676a91307546'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:12 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:12 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:12 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233" returned: 0 in 0.713s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.317s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496864243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c4d736-3f52-4c02-a525-c82b8ffa42a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:01Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Creating volume 72c4d736-3f52-4c02-a525-c82b8ffa42a6 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:12 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:12 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 1073741824 Jul 11 04:20:12 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a32bf79-8219-43ce-93ca-c37f0790add5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1bf191-f1e8-42d2-8577-fa045915c233', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ff534f-b718-4e68-b258-79ca02f02010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume volume-af1bf191-f1e8-42d2-8577-fa045915c233 (af1bf191-f1e8-42d2-8577-fa045915c233): created successfully Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ff534f-b718-4e68-b258-79ca02f02010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (87f8f2d5-4d50-4648-b65f-69cd6d85a917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b262f580-4ba5-43fe-8ed5-20783d7bcf2f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created volume successfully. Jul 11 04:20:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-quobyte-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:13 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Deleted volume successfully. Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a368f4-3539-409b-bc0e-29d052ac48c1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-51ebedf3-d52b-4d34-a66e-dbac73e2889c tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-d9f6f91b-9218-4136-994f-c35a60643daa-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:13 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b Jul 11 04:20:13 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:13 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 1073741824" returned: 0 in 0.891s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:13 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 Jul 11 04:20:13 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:13 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b" returned: 0 in 0.810s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:13 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b Jul 11 04:20:13 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:14 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:14 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:14 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6" returned: 0 in 0.663s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.309s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784163535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4bf5d1-36fa-467c-a3af-0b5b587501fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3c16c70489476db6914f10307a2c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:02Z,use_quota=True,user_id='e3f9453832c1425b9d3f50fb778ac845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Creating volume 6a4bf5d1-36fa-467c-a3af-0b5b587501fb {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:14 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199a2ae7-951c-4054-bf48-d6afb17570c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:14 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb 1073741824 Jul 11 04:20:14 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cd78fd-3d98-4e8a-adce-c7f2a3c130b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:14 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 (72c4d736-3f52-4c02-a525-c82b8ffa42a6): created successfully Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cd78fd-3d98-4e8a-adce-c7f2a3c130b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (5f2ffc00-ca6c-41fd-8dd6-0149cd5ee01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-74eea783-2864-4bd3-af1e-10a4a3cd903e tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created volume successfully. Jul 11 04:20:14 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b" returned: 0 in 0.676s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b" released by "delete_volume" :: held 1.547s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Created reservations ['2d8f58c8-9f32-47bd-9641-d98ec68d6267', '4bb10b02-096a-40e8-936b-47ae787e900f', '3496e8e8-5fa4-4e94-8b53-b4a18c87b6fd', '8d37fa29-16fe-41c9-b499-9b4037b3ec6d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:14 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:14 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:14 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.733s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:20:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:20:15 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb 1073741824" returned: 0 in 0.929s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:15 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb Jul 11 04:20:15 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-quobyte-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a865b75a-0492-4b63-82b9-9ba6701aabe2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:15 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 Jul 11 04:20:15 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:15 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Deleted volume successfully. Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d0895c56-96d0-4e88-a00b-5aca84818243 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-c05c27ae-4ffe-4a36-bc34-5d4c3f8e791b-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:15 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.912s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba7b434-a135-4799-846b-39fadc958908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917abcab8de44caf815eb3f865209189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:19:59Z,use_quota=True,user_id='f49b4743ff084f7ba7752df81da65ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Creating volume 2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:15 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:15 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 1073741824 Jul 11 04:20:15 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64720726-8eb7-482b-8ea3-de926a5716c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4734ee5d-a864-4f8e-a77c-37cb8dd37524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Volume volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb (6a4bf5d1-36fa-467c-a3af-0b5b587501fb): created successfully Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4734ee5d-a864-4f8e-a77c-37cb8dd37524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Flow 'volume_create_manager' (78ca686b-18a7-473e-b09a-f76a8e23cf20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2b47c768-4600-4baf-99e2-d5107b0fd3c5 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created volume successfully. Jul 11 04:20:16 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685" returned: 0 in 0.850s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:16 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685 Jul 11 04:20:16 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:16 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 1073741824" returned: 0 in 0.809s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:16 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:16 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:16 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685" returned: 0 in 0.685s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685" released by "delete_volume" :: held 1.587s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-6a4bf5d1-36fa-467c-a3af-0b5b587501fb-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Created reservations ['8a0ecb86-d3da-40e0-bd09-26a3a6f8ea31', '0d853a97-63a3-43a4-bb7e-8f63c16538f1', '079c39be-b122-4f14-bd47-8b035211a181', 'd85e22fd-bf8f-4103-b01f-515b5c569b81'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-6a4bf5d1-36fa-467c-a3af-0b5b587501fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-quobyte-6a4bf5d1-36fa-467c-a3af-0b5b587501fb" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-6a4bf5d1-36fa-467c-a3af-0b5b587501fb" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5bb15-783d-44d3-9006-3a0fb8138d53]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:17 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:17 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:17 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb Jul 11 04:20:17 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:17 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-2c19c3d0-8466-47f3-a48e-df9533a8fd5a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 0 in 0.833s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.578s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58c6379-abca-4a0c-a732-5a29ad3e2f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36c5095ca174e8fb1fade808c02d157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:01Z,use_quota=True,user_id='36d7a2025d844ea69ac847ed56bf278a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(643e8506-7a5d-46b2-8823-03b0753a72a4),volume_type_id=643e8506-7a5d-46b2-8823-03b0753a72a4)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Creating volume c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:17 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-2c19c3d0-8466-47f3-a48e-df9533a8fd5a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:17 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 1073741824 Jul 11 04:20:17 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Attempting download of 692d7db8-3753-4e44-a41c-299705cacf23 ((None, [{'url': 'file:///opt/stack/data/glance/images/692d7db8-3753-4e44-a41c-299705cacf23', 'metadata': {}}])) to volume 2ba7b434-a135-4799-846b-39fadc958908. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "cinder-quobyte-2c19c3d0-8466-47f3-a48e-df9533a8fd5a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-2c19c3d0-8466-47f3-a48e-df9533a8fd5a" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[258c9268-72eb-435e-8dbb-dd6b4f26f652]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc739a87-2888-4403-9043-bd2ea881aa56]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:17 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj Jul 11 04:20:17 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:17 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a Jul 11 04:20:17 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:18 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.904s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Deleted volume successfully. Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-703d9801-8c60-445e-82a6-6a6494ff4b66 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-d4a0ee29-8d40-4af8-a7e1-d76e7eafe685-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:18 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb" returned: 0 in 1.158s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:18 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb Jul 11 04:20:18 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:18 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj" returned: 0 in 0.953s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:18 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a" returned: 0 in 1.007s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:18 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a Jul 11 04:20:18 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:18 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj Jul 11 04:20:18 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:18 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 1073741824" returned: 0 in 1.295s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:19 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:19 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:19 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-6a4bf5d1-36fa-467c-a3af-0b5b587501fb" returned: 0 in 0.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-6a4bf5d1-36fa-467c-a3af-0b5b587501fb" released by "delete_volume" :: held 2.076s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created reservations ['9308f457-5629-4ca2-9fa8-5c51a827cbdb', 'b34a7422-6b5d-4783-8163-c3c2f30d4099', '8b9654d2-34e4-4268-ac39-31fcc183ce4c', 'cd48f20c-7626-49a7-92ac-3b06dc43666a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:19 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:19 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:19 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2c19c3d0-8466-47f3-a48e-df9533a8fd5a" returned: 0 in 0.795s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-quobyte-2c19c3d0-8466-47f3-a48e-df9533a8fd5a" released by "delete_volume" :: held 1.876s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:19 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj" returned: 1 in 0.889s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_692d7db8-3753-4e44-a41c-299705cacf23_3w2dvrdj' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a047240-ad11-4611-8f59-e8312860efc0]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Created reservations ['f02f9dda-96d7-4b73-8a68-f7d9c263e2c8', '7ca24178-2d80-4c7d-a851-048c471997bc', 'ae3ecc5b-247a-4573-bfd4-ce46979d85c6', 'f37aed90-9138-469f-8c0f-709db4c69e65'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:19 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 0 in 0.814s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Attempting download of dd1bc35d-33e6-4b70-abc8-24f0334cbfda ((None, [{'url': 'file:///opt/stack/data/glance/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'metadata': {}}])) to volume c58c6379-abca-4a0c-a732-5a29ad3e2f59. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 11 04:20:19 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD Jul 11 04:20:19 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25a97c-d756-46a5-b2f1-e3edc2b86f58]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:19 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:19 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:20 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk Jul 11 04:20:20 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:20 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.950s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Deleted volume successfully. Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-72c4d736-3f52-4c02-a525-c82b8ffa42a6-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6de892eb-5014-4af0-94cc-cd4033895946 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-6a4bf5d1-36fa-467c-a3af-0b5b587501fb-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-72c4d736-3f52-4c02-a525-c82b8ffa42a6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-quobyte-72c4d736-3f52-4c02-a525-c82b8ffa42a6" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-72c4d736-3f52-4c02-a525-c82b8ffa42a6" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176e176-bdca-41c6-8482-2ea5e868de56]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:20 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:20 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.995s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:20 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Deleted volume successfully. Jul 11 04:20:20 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD" returned: 0 in 1.198s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1fee899-9f82-4569-bf63-5b163b17f692 tempest-CreateVolumesFromImageTest-1296604708 None] Lock "cinder-2c19c3d0-8466-47f3-a48e-df9533a8fd5a-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:21 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD Jul 11 04:20:21 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:21 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk" returned: 0 in 1.278s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:21 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk Jul 11 04:20:21 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:21 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6" returned: 0 in 1.195s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:21 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6 Jul 11 04:20:21 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:21 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD" returned: 1 in 1.032s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] 692d7db8-3753-4e44-a41c-299705cacf23 was raw, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:20:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:21 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:21 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:22 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk" returned: 1 in 0.933s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_zlsodiyk' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dc0504-1938-4391-8fe5-4582aacdc6d2]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:22 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD Jul 11 04:20:22 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:22 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-72c4d736-3f52-4c02-a525-c82b8ffa42a6" returned: 0 in 0.739s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-72c4d736-3f52-4c02-a525-c82b8ffa42a6" released by "delete_volume" :: held 2.009s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created reservations ['914c365b-f345-4cde-9b6d-e94edb214b1c', '9dd08c17-3b57-4aa3-9644-6f7c69d3b75f', '10be462e-9d58-43a9-8134-f9fbacec1443', 'af1d5e8d-f3c0-4000-8ea1-3a42de82314f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:22 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:22 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:22 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 0 in 0.975s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_692d7db8-3753-4e44-a41c-299705cacf23_1ongqk68devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:20:22 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:20:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:22 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 1G Jul 11 04:20:22 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:23 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:23 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD Jul 11 04:20:23 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:23 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.929s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Deleted volume successfully. Jul 11 04:20:23 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 1G" returned: 0 in 0.878s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-4262dde7-4150-4c65-86ff-862b34cd9577 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-72c4d736-3f52-4c02-a525-c82b8ffa42a6-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f9a3ea-b45d-4259-8fbc-b3852d0e6f87]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-af1bf191-f1e8-42d2-8577-fa045915c233-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:23 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:23 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Flow 'volume_create_manager' (bfa6ff90-9127-4c0f-82e4-2541605ddf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca98246-c3a3-4bed-98b3-80b24c4cbb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-af1bf191-f1e8-42d2-8577-fa045915c233-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca98246-c3a3-4bed-98b3-80b24c4cbb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1600620952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db824a-b788-4d0f-9dcb-c6cfe6504661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471607144daf4103abb32aa5b46aa82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:24Z,use_quota=True,user_id='357e32668231476095b50d268494051c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febd1033-7abb-4a3b-8e17-aa5ffe0b0e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febd1033-7abb-4a3b-8e17-aa5ffe0b0e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:24 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c61c4c-18f2-4dcc-8e50-ae68a3a5af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c61c4c-18f2-4dcc-8e50-ae68a3a5af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51db824a-b788-4d0f-9dcb-c6cfe6504661', 'volume_name': 'volume-51db824a-b788-4d0f-9dcb-c6cfe6504661', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c896201-2a9f-42fc-ac48-3f0132c3c8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c896201-2a9f-42fc-ac48-3f0132c3c8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799adfda-4d54-438c-9f72-33c7d02c3c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:24 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Volume 51db824a-b788-4d0f-9dcb-c6cfe6504661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51db824a-b788-4d0f-9dcb-c6cfe6504661', 'volume_size': 1} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1600620952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db824a-b788-4d0f-9dcb-c6cfe6504661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471607144daf4103abb32aa5b46aa82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:24Z,use_quota=True,user_id='357e32668231476095b50d268494051c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Creating volume 51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:24 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD" returned: 1 in 1.052s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] dd1bc35d-33e6-4b70-abc8-24f0334cbfda was raw, converting to raw {{(pid=87437) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1122}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:24 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 1073741824 Jul 11 04:20:24 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:24 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-quobyte-af1bf191-f1e8-42d2-8577-fa045915c233" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:24 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-af1bf191-f1e8-42d2-8577-fa045915c233" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee7b2f4-7c8b-4d8f-b2fc-6cb3d6662378]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:24 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 Jul 11 04:20:24 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:24 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 0 in 0.940s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:24 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:24 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:25 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 0 in 0.852s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dd1bc35d-33e6-4b70-abc8-24f0334cbfda_h0eiupsmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:20:25 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Converted 0.00 MB image at 0.00 MB/s Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:25 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 1G Jul 11 04:20:25 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:25 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 1073741824" returned: 0 in 1.155s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:25 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233" returned: 0 in 1.085s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:25 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:25 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:25 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233 Jul 11 04:20:25 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:25 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 1 in 0.985s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Downloaded image 692d7db8-3753-4e44-a41c-299705cacf23 ((None, [{'url': 'file:///opt/stack/data/glance/images/692d7db8-3753-4e44-a41c-299705cacf23', 'metadata': {}}])) to volume 2ba7b434-a135-4799-846b-39fadc958908 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Temporary image 692d7db8-3753-4e44-a41c-299705cacf23 for user f49b4743ff084f7ba7752df81da65ec2 is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Marking volume 2ba7b434-a135-4799-846b-39fadc958908 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Copying metadata from image 692d7db8-3753-4e44-a41c-299705cacf23 to 2ba7b434-a135-4799-846b-39fadc958908. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Creating volume glance metadata for volume 2ba7b434-a135-4799-846b-39fadc958908 backed by image 692d7db8-3753-4e44-a41c-299705cacf23 with: {'image_id': '692d7db8-3753-4e44-a41c-299705cacf23', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1a7f85a8dbdb8ab7c38512c67836f79b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:20:25 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 1G" returned: 0 in 0.866s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f7a3ff-9801-4d6e-bfc2-a560d4a2b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba7b434-a135-4799-846b-39fadc958908', 'volume_size': 1, 'image_id': '692d7db8-3753-4e44-a41c-299705cacf23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/692d7db8-3753-4e44-a41c-299705cacf23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a7f85a8dbdb8ab7c38512c67836f79b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '917abcab8de44caf815eb3f865209189', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f658c7747f09a43287e29de6daa176f2f437ab1b7d605a16a62c17048bd9d342712787cb0ddb431a62d8c034479a1b4cb642d2c4c42eae9cf3ecf652acea7d10', 'id': '692d7db8-3753-4e44-a41c-299705cacf23', 'created_at': datetime.datetime(2026, 7, 11, 2, 19, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 19, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/692d7db8-3753-4e44-a41c-299705cacf23/file', 'properties': {}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74aaa8fd-47fe-497e-ae3c-4ab291f83a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:25 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Volume volume-2ba7b434-a135-4799-846b-39fadc958908 (2ba7b434-a135-4799-846b-39fadc958908): created successfully Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74aaa8fd-47fe-497e-ae3c-4ab291f83a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Flow 'volume_create_manager' (9ba0240f-b3e7-4b4f-b329-a58f960a51a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c3fd5a-99bb-42d0-ab51-709b20c045f2]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:25 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d17cfa23-2b2f-486d-9359-f61532321d41 tempest-VolumeImageDependencyTests-1731552908 None] Created volume successfully. Jul 11 04:20:26 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799adfda-4d54-438c-9f72-33c7d02c3c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51db824a-b788-4d0f-9dcb-c6cfe6504661', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38999f5-48a2-4ea8-9062-e27d9915add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Volume volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 (51db824a-b788-4d0f-9dcb-c6cfe6504661): created successfully Jul 11 04:20:26 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:26 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38999f5-48a2-4ea8-9062-e27d9915add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Flow 'volume_create_manager' (bfa6ff90-9127-4c0f-82e4-2541605ddf91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-db23f1d8-6673-4cc7-b2a6-442d55ec698d tempest-VolumeDependencyTests-727476921 None] Created volume successfully. Jul 11 04:20:26 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-af1bf191-f1e8-42d2-8577-fa045915c233" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-af1bf191-f1e8-42d2-8577-fa045915c233" released by "delete_volume" :: held 1.935s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created reservations ['81ef419e-9230-490c-8c34-52ce553659d0', '94660041-4330-41cb-b418-f554b5bda114', '18c97a33-ef6d-44bf-a983-bb8c6a9f7817', '8e3c9db8-cf1f-49ce-8184-68ee3b108793'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:26 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:26 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Acquiring lock "cinder-2ba7b434-a135-4799-846b-39fadc958908-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Lock "cinder-2ba7b434-a135-4799-846b-39fadc958908-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-quobyte-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a" acquired by "delete_volume" :: waited 0.042s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Acquiring lock "cinder-quobyte-2ba7b434-a135-4799-846b-39fadc958908" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6edb339-2dbe-4559-9dc2-5756d98d1586]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Lock "cinder-quobyte-2ba7b434-a135-4799-846b-39fadc958908" acquired by "delete_volume" :: waited 0.058s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[48907a03-52dd-4469-9727-8101a31b2f17]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:26 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a Jul 11 04:20:26 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:26 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:26 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:26 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 0 in 0.984s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:27 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:27 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:27 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.904s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Deleted volume successfully. Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-672b2be1-0fbe-468f-a3fb-79d1dff81727 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-af1bf191-f1e8-42d2-8577-fa045915c233-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:27 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a" returned: 0 in 0.949s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Creating offline snapshot 4c9fc199-a8e7-4942-b988-3330a5809428 of volume 51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:20:27 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a Jul 11 04:20:27 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aafca8a-020a-44b0-af91-a879a13c070e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:27 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:27 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:27 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 1 in 0.929s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Downloaded image dd1bc35d-33e6-4b70-abc8-24f0334cbfda ((None, [{'url': 'file:///opt/stack/data/glance/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'metadata': {}}])) to volume c58c6379-abca-4a0c-a732-5a29ad3e2f59 successfully. {{(pid=87437) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Temporary image dd1bc35d-33e6-4b70-abc8-24f0334cbfda for user 36d7a2025d844ea69ac847ed56bf278a is deleted. {{(pid=87437) fetch /opt/stack/cinder/cinder/image/image_utils.py:1437}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.volume_utils [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Marking volume c58c6379-abca-4a0c-a732-5a29ad3e2f59 as bootable. {{(pid=87437) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Copying metadata from image dd1bc35d-33e6-4b70-abc8-24f0334cbfda to c58c6379-abca-4a0c-a732-5a29ad3e2f59. {{(pid=87437) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Creating volume glance metadata for volume c58c6379-abca-4a0c-a732-5a29ad3e2f59 backed by image dd1bc35d-33e6-4b70-abc8-24f0334cbfda with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c6c5323dcdbb70ca8e1816515a1e44d1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87437) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 11 04:20:27 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 0 in 1.156s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a55ea6-74fd-472a-aa6c-fde192d71b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59', 'volume_size': 1, 'image_id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6c5323dcdbb70ca8e1816515a1e44d1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a36c5095ca174e8fb1fade808c02d157', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7560100b94c3206dc87565cb0925c3bd6a8cfee7a0e6f5ce1b57d9e6caa4b048216f8858b923f92115b3cbb9edc93f6cc6f720593d3a718adb6d036da53f58d', 'id': 'dd1bc35d-33e6-4b70-abc8-24f0334cbfda', 'created_at': datetime.datetime(2026, 7, 11, 2, 19, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 11, 2, 19, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dd1bc35d-33e6-4b70-abc8-24f0334cbfda/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:27 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0613b6e-159f-4ab3-921f-035ae1166c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:28 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Volume volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 (c58c6379-abca-4a0c-a732-5a29ad3e2f59): created successfully Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0613b6e-159f-4ab3-921f-035ae1166c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:28 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:28 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Flow 'volume_create_manager' (f4cd2136-29e8-4d8e-856b-732e93312022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-45287230-83b1-4cad-a8f9-95229cc6a935 tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Created volume successfully. Jul 11 04:20:28 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a" returned: 0 in 0.837s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a" released by "delete_volume" :: held 1.848s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created reservations ['89682d4c-69ac-4c8d-b72d-48d421720e64', 'aec6358a-ac58-4ac1-9342-328f0a648d96', '399bec2a-81a2-41c3-a9f2-8be4bb6b3e62', 'e58dd5c7-7d7c-4e08-8dca-c7f77a056595'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:28 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.918s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:28 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 1G Jul 11 04:20:28 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:28 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:28 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:28 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 1 in 0.800s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-477ef67e-a983-485a-bd20-ecd0543168ba-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:28 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908 Jul 11 04:20:28 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-477ef67e-a983-485a-bd20-ecd0543168ba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-quobyte-477ef67e-a983-485a-bd20-ecd0543168ba" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-477ef67e-a983-485a-bd20-ecd0543168ba" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dba3ac5-6eb6-4b6f-8c0b-24f9f57cab0b]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Acquiring lock "cinder-c58c6379-abca-4a0c-a732-5a29ad3e2f59-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "cinder-c58c6379-abca-4a0c-a732-5a29ad3e2f59-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:29 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba Jul 11 04:20:29 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Acquiring lock "cinder-quobyte-c58c6379-abca-4a0c-a732-5a29ad3e2f59" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "cinder-quobyte-c58c6379-abca-4a0c-a732-5a29ad3e2f59" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba9b25-ad76-447f-912d-3d963a1d1fce]: (4, 'raw') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:29 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.761s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:29 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Deleted volume successfully. Jul 11 04:20:29 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:29 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d89294af-e092-4fb4-a2bf-57bac856963f tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-5aa7f2c8-8c54-44c1-b4c4-6f2dea9ccc0a-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:29 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 1G" returned: 0 in 1.100s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:29 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 Jul 11 04:20:29 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:29 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-2ba7b434-a135-4799-846b-39fadc958908" returned: 0 in 1.040s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Lock "cinder-quobyte-2ba7b434-a135-4799-846b-39fadc958908" released by "delete_volume" :: held 3.068s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Created reservations ['5591b8a0-7f68-4650-b89c-95a06ddbae60', 'e194eb02-db85-423c-b63a-5a2aa6e75c81', 'cc2dc144-0be3-4cc3-8338-94f1043a8826', '6cc8879a-9d72-4609-8eeb-66fc5eda2d5e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:29 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba" returned: 0 in 1.050s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:29 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba Jul 11 04:20:29 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:30 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:30 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:30 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 0 in 1.011s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:30 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:30 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:30 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428" returned: 0 in 0.817s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:30 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 is being set with open permissions: ugo+rw Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:30 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 Jul 11 04:20:30 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:30 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-477ef67e-a983-485a-bd20-ecd0543168ba" returned: 0 in 0.753s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-477ef67e-a983-485a-bd20-ecd0543168ba" released by "delete_volume" :: held 1.865s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created reservations ['a2991ed5-c008-4495-8833-3d30be570b33', 'a4c4f2ed-7b07-4a00-aaf1-dc4ac23c990b', 'adc835f8-9b54-4769-8c8b-d387e01e9970', 'f5ad977d-72d0-4d7d-a18c-387fc5201ea5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:30 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.785s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Deleted volume successfully. Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6fa60f15-866e-4926-a059-4bc761f6e36a tempest-VolumeImageDependencyTests-1731552908 None] Lock "cinder-2ba7b434-a135-4799-846b-39fadc958908-delete_volume" released by "delete_volume" :: held 4.327s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:30 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:30 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:31 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 1 in 0.858s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59' failed. Not Retrying. {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-eab92edc-3e94-4322-af28-8b70b1ab2a52-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:31 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59 Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-eab92edc-3e94-4322-af28-8b70b1ab2a52-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:31 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "cinder-quobyte-eab92edc-3e94-4322-af28-8b70b1ab2a52" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-eab92edc-3e94-4322-af28-8b70b1ab2a52" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7c5ba-72b6-4208-8373-32406d22d1fc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:31 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 Jul 11 04:20:31 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:31 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428" returned: 0 in 0.891s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:31 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info Jul 11 04:20:31 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:31 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.000s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Deleted volume successfully. Jul 11 04:20:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-52f0b144-c1a8-471c-a9d6-b4ed3f788db2 tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-477ef67e-a983-485a-bd20-ecd0543168ba-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:31 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-c58c6379-abca-4a0c-a732-5a29ad3e2f59" returned: 0 in 0.940s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "cinder-quobyte-c58c6379-abca-4a0c-a732-5a29ad3e2f59" released by "delete_volume" :: held 2.913s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Created reservations ['da1921a0-ac87-4e2d-ad0f-8b1ef2e283de', '944fea40-356c-4475-b281-5ffca2091898', 'cf6db237-bc04-46f1-9ff0-c6470587ea12', 'fad43872-f84f-474e-857b-ea7f6e5f61e6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:32 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:32 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:32 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info" returned: 0 in 0.870s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:32 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info is being set with open permissions: ugo+rw Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:32 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52" returned: 0 in 1.079s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:32 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info Jul 11 04:20:32 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:32 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52 Jul 11 04:20:32 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:33 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.info" returned: 0 in 0.946s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.721s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-75eb35fe-7f5d-420a-a84f-4f0a81c56767 tempest-VolumeDependencyTests-727476921 None] Create snapshot completed successfully Jul 11 04:20:33 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.229s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:33 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Deleted volume successfully. Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-42b6b1e5-f4d5-488d-a331-1f8b098047fb tempest-VolumeAndVolumeTypeFromImageTest-661955841 None] Lock "cinder-c58c6379-abca-4a0c-a732-5a29ad3e2f59-delete_volume" released by "delete_volume" :: held 4.420s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:33 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-eab92edc-3e94-4322-af28-8b70b1ab2a52" returned: 0 in 1.181s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-quobyte-eab92edc-3e94-4322-af28-8b70b1ab2a52" released by "delete_volume" :: held 2.320s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Created reservations ['1e6defc3-a38a-4e90-9599-39a3a5ec4d53', 'c69a536d-cdbb-4430-90a7-078306ab5d0b', 'eb7608a9-cf50-4764-a1bc-f37df95e1e30', '972db04e-96c3-4fc0-984f-38bed1627e0e'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:33 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:33 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:34 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.920s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Deleted volume successfully. Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-8bb84508-23f4-43fe-b379-d49b402bdecd tempest-CreateVolumesFromSourceVolumeTest-1727001076 None] Lock "cinder-eab92edc-3e94-4322-af28-8b70b1ab2a52-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Flow 'volume_create_manager' (c9f6e7ec-40b4-451a-b860-be7927a0e256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979f6543-b86a-4c12-bc8a-b213d43bf7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979f6543-b86a-4c12-bc8a-b213d43bf7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-523096780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d121ef6b-cb5f-4e55-bfd8-f0373a018b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471607144daf4103abb32aa5b46aa82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c9fc199-a8e7-4942-b988-3330a5809428,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:35Z,use_quota=True,user_id='357e32668231476095b50d268494051c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c07d55-98a1-4870-8c53-1f2bf82facc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c07d55-98a1-4870-8c53-1f2bf82facc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c78db51-801b-485f-89d8-ea6001d01e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c78db51-801b-485f-89d8-ea6001d01e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd121ef6b-cb5f-4e55-bfd8-f0373a018b23', 'volume_name': 'volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23', 'volume_size': 1, 'snapshot_id': '4c9fc199-a8e7-4942-b988-3330a5809428'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea5906f-e4cb-400b-bc09-edf3fdb65cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea5906f-e4cb-400b-bc09-edf3fdb65cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731b6e8d-f443-4ac7-8bdd-4c71fbd61856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:34 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Volume d121ef6b-cb5f-4e55-bfd8-f0373a018b23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23', 'volume_size': 1, 'snapshot_id': '4c9fc199-a8e7-4942-b988-3330a5809428'} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-quobyte-4c9fc199-a8e7-4942-b988-3330a5809428-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-4c9fc199-a8e7-4942-b988-3330a5809428-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Creating volume d121ef6b-cb5f-4e55-bfd8-f0373a018b23 from snapshot 4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-quobyte-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] snapshot: 4c9fc199-a8e7-4942-b988-3330a5809428, volume: d121ef6b-cb5f-4e55-bfd8-f0373a018b23, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a3b92-74c5-42c9-a6e2-44a9ef9b922f]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:35 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 Jul 11 04:20:35 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:35 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428" returned: 0 in 1.099s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db824a-b788-4d0f-9dcb-c6cfe6504661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:20:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:20:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:20:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a3a59-0733-4c43-8eec-fdd4b7f7a165]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:36 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:36 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (7ff25a64-2b95-4ecd-9f51-2c9170244d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af258226-36e5-4915-985d-9bddccf7316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af258226-36e5-4915-985d-9bddccf7316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448665826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d099d1a8-9fc9-4a40-94df-34202b4ab30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:37Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c0235e-12f1-49ab-b1e3-0c0037ea1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c0235e-12f1-49ab-b1e3-0c0037ea1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab4c05b-5f3e-42f0-bdf5-ea9cf077ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab4c05b-5f3e-42f0-bdf5-ea9cf077ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd099d1a8-9fc9-4a40-94df-34202b4ab30f', 'volume_name': 'volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6becc4b-b963-41ab-a9c2-c81d989ff65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6becc4b-b963-41ab-a9c2-c81d989ff65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c2c3b9-4733-48f4-ad0b-fc5b8595e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:36 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Volume d099d1a8-9fc9-4a40-94df-34202b4ab30f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f', 'volume_size': 1} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:36 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.960s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:20:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:36 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 Jul 11 04:20:36 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (6c58c704-ff1d-4970-9bc8-08d725eafa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003c865a-ee0a-4185-9672-fb7c9b4bf323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003c865a-ee0a-4185-9672-fb7c9b4bf323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43531614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2a3566-c457-421f-8b94-608372cf3230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:39Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34455ff3-5f7c-4326-9b4a-3e2b48e17aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34455ff3-5f7c-4326-9b4a-3e2b48e17aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de6d37f-2e5d-4514-9363-8b9e3e98ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de6d37f-2e5d-4514-9363-8b9e3e98ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2a3566-c457-421f-8b94-608372cf3230', 'volume_name': 'volume-4f2a3566-c457-421f-8b94-608372cf3230', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccefd9f8-ad69-4982-aa8a-ec170178860d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccefd9f8-ad69-4982-aa8a-ec170178860d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aa60a1-5ee1-4e1e-af27-0c2e2490163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:39 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume 4f2a3566-c457-421f-8b94-608372cf3230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2a3566-c457-421f-8b94-608372cf3230', 'volume_size': 1} Jul 11 04:20:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (aa7cff52-72a0-4b34-bfe7-820e3e8892e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e38f44-9367-40fc-a8e2-8649af591ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e38f44-9367-40fc-a8e2-8649af591ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570034043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462811c1-9160-415d-826f-8fa055f39be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:40Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1ee97a-06a2-4987-9340-66115020b8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1ee97a-06a2-4987-9340-66115020b8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dd0037-902b-496e-b0ea-696901fa3673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dd0037-902b-496e-b0ea-696901fa3673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462811c1-9160-415d-826f-8fa055f39be8', 'volume_name': 'volume-462811c1-9160-415d-826f-8fa055f39be8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002a47de-9d34-4080-84b2-44b5506da908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002a47de-9d34-4080-84b2-44b5506da908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb9bd4-452b-421a-ae38-e22ccbaa152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:40 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Volume 462811c1-9160-415d-826f-8fa055f39be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462811c1-9160-415d-826f-8fa055f39be8', 'volume_size': 1} Jul 11 04:20:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:42 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" returned: 0 in 5.223s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a276e-2d8f-4ed6-bf0d-7df3e930cbc7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:42 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:42 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:43 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.870s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:20:43 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Converted 1024.00 MB image at 196.03 MB/s Jul 11 04:20:43 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 is being set with open permissions: ugo+rw Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:43 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 Jul 11 04:20:43 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:43 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" returned: 0 in 0.599s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" released by "_copy_volume_from_snapshot" :: held 8.866s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-4c9fc199-a8e7-4942-b988-3330a5809428-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" released by "_create_volume_from_snapshot" :: held 8.903s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.926s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.970s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448665826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d099d1a8-9fc9-4a40-94df-34202b4ab30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:37Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Creating volume d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:43 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:43 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f 1073741824 Jul 11 04:20:43 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731b6e8d-f443-4ac7-8bdd-4c71fbd61856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23', 'volume_size': 1, 'snapshot_id': '4c9fc199-a8e7-4942-b988-3330a5809428'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b8f5f1-1fbc-4f32-b10d-c961b9dd51e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Volume volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 (d121ef6b-cb5f-4e55-bfd8-f0373a018b23): created successfully Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b8f5f1-1fbc-4f32-b10d-c961b9dd51e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Flow 'volume_create_manager' (c9f6e7ec-40b4-451a-b860-be7927a0e256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-92d03090-26fd-468c-88d9-a3b15313f437 tempest-VolumeDependencyTests-727476921 None] Created volume successfully. Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-4c9fc199-a8e7-4942-b988-3330a5809428-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-4c9fc199-a8e7-4942-b988-3330a5809428-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-quobyte-51db824a-b788-4d0f-9dcb-c6cfe6504661" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-51db824a-b788-4d0f-9dcb-c6cfe6504661" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-quobyte-4c9fc199-a8e7-4942-b988-3330a5809428" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-4c9fc199-a8e7-4942-b988-3330a5809428" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Deleting offline snapshot 4c9fc199-a8e7-4942-b988-3330a5809428 of volume 51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] snapshot_file for this snap is: volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffd76d0-5c93-4b79-b4a5-5480bfb9f7bc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:44 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 Jul 11 04:20:44 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:44 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f 1073741824" returned: 0 in 0.939s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:44 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f Jul 11 04:20:44 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:45 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428" returned: 0 in 0.866s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51db824a-b788-4d0f-9dcb-c6cfe6504661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6185e7-e278-4064-a4d2-1c9c8b40f939]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:45 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f" returned: 0 in 0.709s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.123s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43531614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2a3566-c457-421f-8b94-608372cf3230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:39Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating volume 4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:45 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c2c3b9-4733-48f4-ad0b-fc5b8595e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987c676e-0639-4441-86c0-d57dbf5d4041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:45 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 1073741824 Jul 11 04:20:45 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:45 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Volume volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f (d099d1a8-9fc9-4a40-94df-34202b4ab30f): created successfully Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987c676e-0639-4441-86c0-d57dbf5d4041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:45 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (7ff25a64-2b95-4ecd-9f51-2c9170244d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:45 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:45 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:45 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-687a24bf-7a13-4fda-b41e-0301fa7252a8 tempest-ProjectReaderTests-1366321205 None] Created volume successfully. Jul 11 04:20:46 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:46 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 Jul 11 04:20:46 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:46 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 1073741824" returned: 0 in 0.936s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:46 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 Jul 11 04:20:46 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:47 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428" returned: 0 in 0.862s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:47 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428 Jul 11 04:20:47 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:47 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230" returned: 0 in 0.727s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.639s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570034043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462811c1-9160-415d-826f-8fa055f39be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:40Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Creating volume 462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:20:47 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:47 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 1073741824 Jul 11 04:20:47 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aa60a1-5ee1-4e1e-af27-0c2e2490163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2a3566-c457-421f-8b94-608372cf3230', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bc08d2-fcbe-4dc7-ab14-100dd73974f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:47 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume volume-4f2a3566-c457-421f-8b94-608372cf3230 (4f2a3566-c457-421f-8b94-608372cf3230): created successfully Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bc08d2-fcbe-4dc7-ab14-100dd73974f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (6c58c704-ff1d-4970-9bc8-08d725eafa54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e540cb6e-28aa-490a-8684-b8fd7c5c35a0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created volume successfully. Jul 11 04:20:47 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661.4c9fc199-a8e7-4942-b988-3330a5809428" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-4c9fc199-a8e7-4942-b988-3330a5809428" released by "_delete_snapshot" :: held 3.431s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-51db824a-b788-4d0f-9dcb-c6cfe6504661" released by "delete_snapshot" :: held 3.458s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Created reservations ['366167f3-98dc-4bec-b23d-4dac1ac11623', 'ab030185-ce79-4171-bdb2-9a6821078c72', '8ad46bac-3e69-4cc6-9e0f-c64a0caefb92', '965fa829-6ef5-4dd2-bd11-d74970d33cf5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Delete snapshot completed successfully. Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-fd69ea0b-ecea-4980-a469-b64394b12798 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-4c9fc199-a8e7-4942-b988-3330a5809428-delete_snapshot" released by "delete_snapshot" :: held 3.608s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:47 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 1073741824" returned: 0 in 0.851s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:48 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 Jul 11 04:20:48 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-51db824a-b788-4d0f-9dcb-c6cfe6504661-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Lock "cinder-51db824a-b788-4d0f-9dcb-c6cfe6504661-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:48 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.936s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ceb9bd4-452b-421a-ae38-e22ccbaa152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462811c1-9160-415d-826f-8fa055f39be8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc129551-773a-44e3-83e2-69b95ce330b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Creating offline snapshot e1ea9630-9f19-40cf-a1db-2f60c9061a68 of volume d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-quobyte-51db824a-b788-4d0f-9dcb-c6cfe6504661" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:48 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Volume volume-462811c1-9160-415d-826f-8fa055f39be8 (462811c1-9160-415d-826f-8fa055f39be8): created successfully Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc129551-773a-44e3-83e2-69b95ce330b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (aa7cff52-72a0-4b34-bfe7-820e3e8892e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ca321-4216-4cfd-822d-202d87d85371]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-51db824a-b788-4d0f-9dcb-c6cfe6504661" acquired by "delete_volume" :: waited 0.042s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:48 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-eaad2f44-e843-409d-a345-eb3d0445b35a tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f590c61-7ab1-4e3d-bc44-98b24b5b8e33]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:48 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f Jul 11 04:20:48 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:48 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:48 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:49 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:49 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 1G Jul 11 04:20:49 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:49 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.849s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:49 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661 Jul 11 04:20:49 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:50 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 1G" returned: 0 in 0.839s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:50 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 Jul 11 04:20:50 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:50 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-51db824a-b788-4d0f-9dcb-c6cfe6504661" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-51db824a-b788-4d0f-9dcb-c6cfe6504661" released by "delete_volume" :: held 1.676s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Created reservations ['92602a95-2787-46f1-a552-5cf37ab6a1c2', 'bf7d4909-b186-40c2-b536-8f746649ad20', 'eb963d52-a0e2-48d8-a6d0-d48f0e936299', '78293790-7f35-45a9-a952-d8965892edc3'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:50 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:50 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-d121ef6b-cb5f-4e55-bfd8-f0373a018b23-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-d121ef6b-cb5f-4e55-bfd8-f0373a018b23-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "cinder-quobyte-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f013ed7e-dd97-40a1-ad15-d35689e9ce54]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:51 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68" returned: 0 in 0.738s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:51 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 is being set with open permissions: ugo+rw Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:51 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 Jul 11 04:20:51 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:51 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 Jul 11 04:20:51 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:51 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.656s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Deleted volume successfully. Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b6b3bf9c-d455-4a71-838e-1b519ca3debb tempest-VolumeDependencyTests-727476921 None] Lock "cinder-51db824a-b788-4d0f-9dcb-c6cfe6504661-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:51 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68" returned: 0 in 0.662s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:51 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:51 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" returned: 0 in 0.770s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:51 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:51 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23 Jul 11 04:20:51 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:52 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info" returned: 0 in 0.643s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:52 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info is being set with open permissions: ugo+rw Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:52 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info Jul 11 04:20:52 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:52 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" returned: 0 in 0.702s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-quobyte-d121ef6b-cb5f-4e55-bfd8-f0373a018b23" released by "delete_volume" :: held 1.523s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Created reservations ['105e213f-c5b3-4e8f-9dad-dadd215b4047', '0d6fe286-316c-4ba5-a340-c217d3733c68', '75bac581-ba9b-41f8-8e12-f22bf1a71db6', '8da6f2d8-a574-410e-9f28-fa6906b5f4c7'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:52 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:20:52 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:53 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.info" returned: 0 in 0.633s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.418s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.629s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=140,cinder:UPDATE=182,cinder:INSERT=44,cinder:DELETE=13 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating offline snapshot 26ab324d-c88a-4268-ba27-a17744f17ac6 of volume 4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:20:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c0eba81c-f154-4274-9e24-89982c6043d2 tempest-ProjectReaderTests-1366321205 None] Create snapshot completed successfully Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef51a5b-df2d-4b07-940a-d14136033794]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:53 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 Jul 11 04:20:53 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:53 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:20:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Deleted volume successfully. Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-05740ef4-2c04-4f7f-a142-73ab2b4fd7f2 tempest-VolumeDependencyTests-727476921 None] Lock "cinder-d121ef6b-cb5f-4e55-bfd8-f0373a018b23-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:53 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230" returned: 0 in 0.819s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:53 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 1G Jul 11 04:20:53 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-e1ea9630-9f19-40cf-a1db-2f60c9061a68-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-e1ea9630-9f19-40cf-a1db-2f60c9061a68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-d099d1a8-9fc9-4a40-94df-34202b4ab30f" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-d099d1a8-9fc9-4a40-94df-34202b4ab30f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-e1ea9630-9f19-40cf-a1db-2f60c9061a68" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-e1ea9630-9f19-40cf-a1db-2f60c9061a68" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Deleting offline snapshot e1ea9630-9f19-40cf-a1db-2f60c9061a68 of volume d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] snapshot_file for this snap is: volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b279039b-5257-4ec4-a4b5-c3115f2f78a9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:54 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 Jul 11 04:20:54 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:54 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 1G" returned: 0 in 0.924s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2a3566-c457-421f-8b94-608372cf3230 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:54 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2a3566-c457-421f-8b94-608372cf3230 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 Jul 11 04:20:54 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:55 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68" returned: 0 in 0.962s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:20:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca12f04-ea26-4d09-863b-1f2c63f824bd]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:55 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f Jul 11 04:20:55 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:55 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2a3566-c457-421f-8b94-608372cf3230 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:55 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 is being set with open permissions: ugo+rw Jul 11 04:20:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:55 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 Jul 11 04:20:55 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:56 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f" returned: 0 in 0.827s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:56 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 Jul 11 04:20:56 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:56 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6" returned: 0 in 0.696s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=133,cinder:UPDATE=189,cinder:INSERT=58,cinder:DELETE=22 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:56 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info Jul 11 04:20:56 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Flow 'volume_create_manager' (98564417-a4c9-43e4-b537-65816c14b058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a886f016-80bc-4e9a-b830-d07821208ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a886f016-80bc-4e9a-b830-d07821208ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5326d713-ed2b-4edd-8e72-79fa51dc5bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db79400c0a74b849c3f81df90c10a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:56Z,use_quota=True,user_id='6af3f9727e4c405688903f19735ab167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01195553-1b00-46fe-9bfe-327155500204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01195553-1b00-46fe-9bfe-327155500204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2a0844-55a3-44a6-b895-4489401cb304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2a0844-55a3-44a6-b895-4489401cb304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5326d713-ed2b-4edd-8e72-79fa51dc5bf8', 'volume_name': 'volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f43cc04-4e8d-493d-82ef-c8541028d9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f43cc04-4e8d-493d-82ef-c8541028d9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79932cd-9133-4c01-ab81-fcd69487bc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:56 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Volume 5326d713-ed2b-4edd-8e72-79fa51dc5bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8', 'volume_size': 1} Jul 11 04:20:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:57 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68" returned: 0 in 0.833s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:57 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68 Jul 11 04:20:57 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:57 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info" returned: 0 in 0.790s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:57 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info is being set with open permissions: ugo+rw Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:57 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info Jul 11 04:20:57 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:57 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f.e1ea9630-9f19-40cf-a1db-2f60c9061a68" returned: 0 in 0.755s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:57 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.info" returned: 0 in 0.700s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.781s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-e1ea9630-9f19-40cf-a1db-2f60c9061a68" released by "_delete_snapshot" :: held 3.523s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.889s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-d099d1a8-9fc9-4a40-94df-34202b4ab30f" released by "delete_snapshot" :: held 3.561s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Creating offline snapshot 2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 of volume 462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:20:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7c173386-8420-4c7b-9b16-3ed081242124 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Create snapshot completed successfully Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b4cc4d-c7b1-4108-b73c-08accea4e4df]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Created reservations ['c792ee29-55df-4a9a-83c6-818c2c249ffe', '65dce767-d4f8-4eba-ab53-51514551801e', '74c8eb12-c00c-431c-941d-eba7594c2744', 'afa3668d-239e-4117-b2f5-63022374cec1'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:20:58 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Delete snapshot completed successfully. Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d05a529c-1c04-4147-b1cb-2a6517976531 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-e1ea9630-9f19-40cf-a1db-2f60c9061a68-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:20:58 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 Jul 11 04:20:58 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-d099d1a8-9fc9-4a40-94df-34202b4ab30f-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-d099d1a8-9fc9-4a40-94df-34202b4ab30f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-d099d1a8-9fc9-4a40-94df-34202b4ab30f" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-d099d1a8-9fc9-4a40-94df-34202b4ab30f" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d53f84c-ce45-4969-a4c0-537f972c93b1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:58 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8" returned: 0 in 0.874s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:58 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 1G Jul 11 04:20:58 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:58 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f Jul 11 04:20:58 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (f3d5c4a4-70ad-4e40-adc3-1d86c4a883e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94fb76-5448-45d0-b6c0-52c7c3b7beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94fb76-5448-45d0-b6c0-52c7c3b7beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508097007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1244bee9-2124-43e1-a9f5-580c6b25f187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:59Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db63c30-a6c0-49b8-8fff-68b24fb2c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db63c30-a6c0-49b8-8fff-68b24fb2c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33a6971-2e04-497e-a4f7-0a64a96cf354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33a6971-2e04-497e-a4f7-0a64a96cf354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1244bee9-2124-43e1-a9f5-580c6b25f187', 'volume_name': 'volume-1244bee9-2124-43e1-a9f5-580c6b25f187', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5b17ba-a868-444f-be95-50e82e813223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5b17ba-a868-444f-be95-50e82e813223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c08d380-a9a8-442d-b60d-063ea2d01839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:20:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume 1244bee9-2124-43e1-a9f5-580c6b25f187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1244bee9-2124-43e1-a9f5-580c6b25f187', 'volume_size': 1} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:20:59 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f" returned: 0 in 0.985s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:20:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:20:59 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f Jul 11 04:20:59 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:00 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (cabbaebf-bd2a-448f-a003-ca5cb4feec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ed6ba-688f-4e72-a8ae-1bd1c818d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 1G" returned: 0 in 1.227s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462811c1-9160-415d-826f-8fa055f39be8 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:00 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462811c1-9160-415d-826f-8fa055f39be8 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 Jul 11 04:21:00 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ed6ba-688f-4e72-a8ae-1bd1c818d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61816960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511af89e-8027-4929-8d09-4959a171df63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:00Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6597c1-db0a-4cac-9e92-481b9afc9fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6597c1-db0a-4cac-9e92-481b9afc9fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba93a48-7f35-4fcd-8af9-b03212b34db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba93a48-7f35-4fcd-8af9-b03212b34db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511af89e-8027-4929-8d09-4959a171df63', 'volume_name': 'volume-511af89e-8027-4929-8d09-4959a171df63', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e90cd3-f0fa-4e88-a823-8552456159a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e90cd3-f0fa-4e88-a823-8552456159a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ea030e-893b-4b6f-a707-afc95e4ef297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume 511af89e-8027-4929-8d09-4959a171df63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511af89e-8027-4929-8d09-4959a171df63', 'volume_size': 1} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (2354d4c9-c989-4e34-a53a-d932079aa444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fa6c43-4a95-4a20-bb8c-156ea4a1ed1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fa6c43-4a95-4a20-bb8c-156ea4a1ed1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1821901452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d020cfb-81b7-4b47-a7d4-530fee2cf3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:00Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8ef77f-a840-4dd6-8951-02269398a10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8ef77f-a840-4dd6-8951-02269398a10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6febf1-7a7a-4c7d-8871-9777d791bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6febf1-7a7a-4c7d-8871-9777d791bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d020cfb-81b7-4b47-a7d4-530fee2cf3dd', 'volume_name': 'volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c8911c-0325-46f0-908a-49b942663402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c8911c-0325-46f0-908a-49b942663402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d1705-d69c-4ef9-862b-fb45488c77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume 1d020cfb-81b7-4b47-a7d4-530fee2cf3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd', 'volume_size': 1} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:00 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d099d1a8-9fc9-4a40-94df-34202b4ab30f" returned: 0 in 0.848s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-d099d1a8-9fc9-4a40-94df-34202b4ab30f" released by "delete_volume" :: held 1.901s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Created reservations ['3a2f088c-e332-437a-bf35-5b25138fe7c7', '8382d02c-6fad-4604-9116-8f576c85066d', '966cb9cf-d095-4b92-9774-e4ed9dbc4542', '358f2bf1-b94c-42c5-85a7-9d8f13d0f163'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:00 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:00 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:00 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (373f82fc-b7a0-416a-8e06-339c28b19471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fc0475-b6c4-4973-95c9-969508ad70ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462811c1-9160-415d-826f-8fa055f39be8 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" returned: 0 in 0.865s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:00 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 is being set with open permissions: ugo+rw Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:00 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 Jul 11 04:21:00 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08fc0475-b6c4-4973-95c9-969508ad70ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846802619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfe34fc-db96-4727-93ff-235c4f8e2e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:01Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98099fa4-6550-43d1-b837-aa2772bcf534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98099fa4-6550-43d1-b837-aa2772bcf534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2093a45e-d54f-4397-8f0d-2c236eca978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2093a45e-d54f-4397-8f0d-2c236eca978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcfe34fc-db96-4727-93ff-235c4f8e2e19', 'volume_name': 'volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdf574c-118a-4c12-95e7-04b748a5840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdf574c-118a-4c12-95e7-04b748a5840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a5ad23-b4f7-42ff-90d8-9bcb767a07ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume fcfe34fc-db96-4727-93ff-235c4f8e2e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19', 'volume_size': 1} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (d99fb0ed-fcbf-4893-a924-643916a64010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b476413c-29bc-47cc-a226-ac2c63b11469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b476413c-29bc-47cc-a226-ac2c63b11469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830377603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75242555-d59d-466a-8e92-553948932ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:01Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6cb838-0792-44f0-b327-2049014c22af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6cb838-0792-44f0-b327-2049014c22af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8901cfb-8fe6-4155-aa28-fd2330d5013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8901cfb-8fe6-4155-aa28-fd2330d5013b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75242555-d59d-466a-8e92-553948932ff3', 'volume_name': 'volume-75242555-d59d-466a-8e92-553948932ff3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f659d6-1bf7-4d3b-bcb9-5bfc78e37eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f659d6-1bf7-4d3b-bcb9-5bfc78e37eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76249cd8-4724-4dbb-9bed-6b6758d706a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume 75242555-d59d-466a-8e92-553948932ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75242555-d59d-466a-8e92-553948932ff3', 'volume_size': 1} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (7e2c83dc-d7f1-434d-ae49-407648b22148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932a4714-5c31-4bdd-8608-5deddb637620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932a4714-5c31-4bdd-8608-5deddb637620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890300742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8516d875-ce23-4e60-a2d4-b9ea4be91144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:02Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7824070a-cef6-4a6e-9e83-4cb5230cf7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7824070a-cef6-4a6e-9e83-4cb5230cf7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c48bc9-6198-4458-8961-e9529f201011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c48bc9-6198-4458-8961-e9529f201011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8516d875-ce23-4e60-a2d4-b9ea4be91144', 'volume_name': 'volume-8516d875-ce23-4e60-a2d4-b9ea4be91144', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ec2773-f782-4548-9311-0df9ed78b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ec2773-f782-4548-9311-0df9ed78b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3e8ec8-86ae-4013-b1f9-43a38861bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:01 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Volume 8516d875-ce23-4e60-a2d4-b9ea4be91144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8516d875-ce23-4e60-a2d4-b9ea4be91144', 'volume_size': 1} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:01 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" returned: 0 in 0.754s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:01 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.892s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Deleted volume successfully. Jul 11 04:21:01 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info Jul 11 04:21:01 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c9b72af1-4de6-4563-8c48-1aa0c75feb93 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-d099d1a8-9fc9-4a40-94df-34202b4ab30f-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:02 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:02 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info is being set with open permissions: ugo+rw Jul 11 04:21:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:02 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info Jul 11 04:21:02 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:02 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.info" returned: 0 in 0.647s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.134s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.394s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5326d713-ed2b-4edd-8e72-79fa51dc5bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db79400c0a74b849c3f81df90c10a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:56Z,use_quota=True,user_id='6af3f9727e4c405688903f19735ab167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Creating volume 5326d713-ed2b-4edd-8e72-79fa51dc5bf8 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:03 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:03 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 1073741824 Jul 11 04:21:03 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-4378298f-d653-4bda-abbd-710c6b3e53cc tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-2efc0cc7-c1b4-423b-aa4c-3e094e497ba9-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Lock "cinder-2efc0cc7-c1b4-423b-aa4c-3e094e497ba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-462811c1-9160-415d-826f-8fa055f39be8" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-462811c1-9160-415d-826f-8fa055f39be8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot 2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 of volume 462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1518f7-846d-46a3-9cbb-2b9115be0843]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:03 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 Jul 11 04:21:03 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:03 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 1073741824" returned: 0 in 0.826s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:03 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 Jul 11 04:21:03 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:04 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" returned: 0 in 0.750s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462811c1-9160-415d-826f-8fa055f39be8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[14150e67-8d8e-4b96-a552-4d4db236e44e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:04 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 Jul 11 04:21:04 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:04 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508097007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1244bee9-2124-43e1-a9f5-580c6b25f187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:20:59Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating volume 1244bee9-2124-43e1-a9f5-580c6b25f187 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:04 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79932cd-9133-4c01-ab81-fcd69487bc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:04 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 1073741824 Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c18383-a341-471c-84d9-edee259649a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:04 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:04 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Volume volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 (5326d713-ed2b-4edd-8e72-79fa51dc5bf8): created successfully Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c18383-a341-471c-84d9-edee259649a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:04 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Flow 'volume_create_manager' (98564417-a4c9-43e4-b537-65816c14b058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:04 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c0eb6d26-bcb2-4b06-8ccf-66b3194ecefc tempest-CinderUnicodeTest-820278581 None] Created volume successfully. Jul 11 04:21:05 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8" returned: 0 in 0.796s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:05 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 Jul 11 04:21:05 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:05 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 1073741824" returned: 0 in 0.940s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:05 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 Jul 11 04:21:05 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Flow 'volume_create_manager' (98e572b3-dd5c-49d2-97f5-064e89ad6cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c968b5-7184-4a2a-b439-a7b9513dc4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c968b5-7184-4a2a-b439-a7b9513dc4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1787965312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b700efcc-832c-4ad8-9dc5-73e493c8d4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db79400c0a74b849c3f81df90c10a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:06Z,use_quota=True,user_id='6af3f9727e4c405688903f19735ab167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ed52e1-0b78-4d3d-9970-307932caf5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ed52e1-0b78-4d3d-9970-307932caf5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f079d55-e1be-4bdb-85a5-d05c375fdf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f079d55-e1be-4bdb-85a5-d05c375fdf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b700efcc-832c-4ad8-9dc5-73e493c8d4e4', 'volume_name': 'volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49024f22-73ea-422e-b249-54d2983c8437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49024f22-73ea-422e-b249-54d2983c8437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5809ad84-55a6-4c76-b406-2fc03059864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:05 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Volume b700efcc-832c-4ad8-9dc5-73e493c8d4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4', 'volume_size': 1} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:05 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" returned: 0 in 0.794s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:06 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9 Jul 11 04:21:06 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:06 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.086s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61816960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511af89e-8027-4929-8d09-4959a171df63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:00Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating volume 511af89e-8027-4929-8d09-4959a171df63 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:06 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c08d380-a9a8-442d-b60d-063ea2d01839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1244bee9-2124-43e1-a9f5-580c6b25f187', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:06 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 1073741824 Jul 11 04:21:06 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffac8c5f-3e5e-4904-80c5-2fc31b38ca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:06 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume volume-1244bee9-2124-43e1-a9f5-580c6b25f187 (1244bee9-2124-43e1-a9f5-580c6b25f187): created successfully Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffac8c5f-3e5e-4904-80c5-2fc31b38ca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (f3d5c4a4-70ad-4e40-adc3-1d86c4a883e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f044f53e-3cec-4cc9-a9e0-1bfa996663fd tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created volume successfully. Jul 11 04:21:06 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8.2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" returned: 0 in 0.640s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-2efc0cc7-c1b4-423b-aa4c-3e094e497ba9" released by "_delete_snapshot" :: held 3.103s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-462811c1-9160-415d-826f-8fa055f39be8" released by "delete_snapshot" :: held 3.134s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Created reservations ['9eb530d4-c7bf-4c36-8612-379b6815e262', 'ddfef515-768e-4d79-a201-c3707827baac', 'd51394e3-b06c-400d-9582-59027e808a51', '72548791-bb0c-4502-bb2c-dfa7ab13a789'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:21:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-5b90f6b7-8cde-4f81-b263-d4e8586d01cb tempest-ProjectMemberTests-476116560 None] Lock "cinder-2efc0cc7-c1b4-423b-aa4c-3e094e497ba9-delete_snapshot" released by "delete_snapshot" :: held 3.268s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:07 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 1073741824" returned: 0 in 0.838s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:07 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 Jul 11 04:21:07 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:07 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.284s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1821901452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d020cfb-81b7-4b47-a7d4-530fee2cf3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:00Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating volume 1d020cfb-81b7-4b47-a7d4-530fee2cf3dd {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:07 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:07 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd 1073741824 Jul 11 04:21:07 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ea030e-893b-4b6f-a707-afc95e4ef297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511af89e-8027-4929-8d09-4959a171df63', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb14cf8b-e6c0-4222-bfbe-c60fdfe5bacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-462811c1-9160-415d-826f-8fa055f39be8-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume volume-511af89e-8027-4929-8d09-4959a171df63 (511af89e-8027-4929-8d09-4959a171df63): created successfully Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb14cf8b-e6c0-4222-bfbe-c60fdfe5bacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (cabbaebf-bd2a-448f-a003-ca5cb4feec91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Lock "cinder-462811c1-9160-415d-826f-8fa055f39be8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c7903914-b684-4967-ba8e-b3673dca23f9 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created volume successfully. Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-462811c1-9160-415d-826f-8fa055f39be8" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-462811c1-9160-415d-826f-8fa055f39be8" acquired by "delete_volume" :: waited 0.012s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[2526583c-e9d4-4a53-be9b-4e00da0c4ebb]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:08 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 Jul 11 04:21:08 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:08 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd 1073741824" returned: 0 in 0.855s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:08 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8" returned: 0 in 0.742s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:08 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd Jul 11 04:21:08 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:08 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8 Jul 11 04:21:08 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:09 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-462811c1-9160-415d-826f-8fa055f39be8" returned: 0 in 0.636s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-462811c1-9160-415d-826f-8fa055f39be8" released by "delete_volume" :: held 1.436s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:09 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.320s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846802619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcfe34fc-db96-4727-93ff-235c4f8e2e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:01Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating volume fcfe34fc-db96-4727-93ff-235c4f8e2e19 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:09 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:09 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 1073741824 Jul 11 04:21:09 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0d1705-d69c-4ef9-862b-fb45488c77b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef27b5b2-1ff9-4e3a-b645-42ba42d8791b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd (1d020cfb-81b7-4b47-a7d4-530fee2cf3dd): created successfully Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef27b5b2-1ff9-4e3a-b645-42ba42d8791b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (2354d4c9-c989-4e34-a53a-d932079aa444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-105cd1f0-6c4e-45d4-9319-6a7bb1cb5814 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created volume successfully. Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Created reservations ['f28bd061-2fd6-4fc4-9406-df845838e09f', '45162265-c8e1-48cd-b5f4-69f9ef952992', 'c8bcd4d1-244e-450b-b414-3a7d8db19756', 'e03f3ed9-efa9-45d4-88fb-6860dd529ba6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:09 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:09 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:10 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.697s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:10 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:21:10 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 1073741824" returned: 0 in 0.882s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-e8381d2a-5556-4445-bea1-344fed3159bb tempest-ProjectMemberTests-476116560 None] Lock "cinder-462811c1-9160-415d-826f-8fa055f39be8-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:10 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 Jul 11 04:21:10 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (f8d541b7-ea11-44fe-9c01-6319a4634c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494ab252-df76-449b-b52d-f9901ef75513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494ab252-df76-449b-b52d-f9901ef75513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340680153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:10Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff98560-44cb-4783-af8a-92a459ba9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff98560-44cb-4783-af8a-92a459ba9778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee405612-f404-44c4-a0ca-33e717edd744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee405612-f404-44c4-a0ca-33e717edd744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0', 'volume_name': 'volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c2219b-cd04-4610-a4a4-c2eb7cb6ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c2219b-cd04-4610-a4a4-c2eb7cb6ab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f50ee6b-0921-441e-bd60-102f39bf2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Volume cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0', 'volume_size': 1} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:10 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19" returned: 0 in 0.645s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.507s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830377603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75242555-d59d-466a-8e92-553948932ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f01dbd21ad4a7d87afd1fa24e198aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:01Z,use_quota=True,user_id='3a85363ca86f42fd83ddcfe9a53f3a15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Creating volume 75242555-d59d-466a-8e92-553948932ff3 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:10 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:10 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 1073741824 Jul 11 04:21:10 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a5ad23-b4f7-42ff-90d8-9bcb767a07ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca952fa-d5eb-4509-9090-187b181ed0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:11 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 (fcfe34fc-db96-4727-93ff-235c4f8e2e19): created successfully Jul 11 04:21:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca952fa-d5eb-4509-9090-187b181ed0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (373f82fc-b7a0-416a-8e06-339c28b19471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1d76de95-7f78-433a-b33a-c718398d7386 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created volume successfully. Jul 11 04:21:11 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 1073741824" returned: 0 in 0.830s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:11 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 Jul 11 04:21:11 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:12 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3" returned: 0 in 0.642s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.839s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890300742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8516d875-ce23-4e60-a2d4-b9ea4be91144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:02Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Creating volume 8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:12 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76249cd8-4724-4dbb-9bed-6b6758d706a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75242555-d59d-466a-8e92-553948932ff3', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:12 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 1073741824 Jul 11 04:21:12 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304274c7-cd4f-41d7-8442-027db62e31d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Volume volume-75242555-d59d-466a-8e92-553948932ff3 (75242555-d59d-466a-8e92-553948932ff3): created successfully Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304274c7-cd4f-41d7-8442-027db62e31d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Flow 'volume_create_manager' (d99fb0ed-fcbf-4893-a924-643916a64010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-41834628-92c0-4b27-9db6-9be14e675ad2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created volume successfully. Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-75242555-d59d-466a-8e92-553948932ff3-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-75242555-d59d-466a-8e92-553948932ff3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-75242555-d59d-466a-8e92-553948932ff3" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-75242555-d59d-466a-8e92-553948932ff3" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57cde22-3f62-45d1-9b0b-d0aea17bed51]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:13 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 Jul 11 04:21:13 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:13 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 1073741824" returned: 0 in 0.899s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:13 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 Jul 11 04:21:13 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:14 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144" returned: 0 in 0.617s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:14 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.252s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1787965312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b700efcc-832c-4ad8-9dc5-73e493c8d4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db79400c0a74b849c3f81df90c10a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:06Z,use_quota=True,user_id='6af3f9727e4c405688903f19735ab167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Creating volume b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:14 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3" returned: 0 in 0.819s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:14 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 1073741824 Jul 11 04:21:14 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:14 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3 Jul 11 04:21:14 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3e8ec8-86ae-4013-b1f9-43a38861bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8516d875-ce23-4e60-a2d4-b9ea4be91144', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc456ce-e1f3-4530-8cc4-ef69f65314ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:14 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Volume volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 (8516d875-ce23-4e60-a2d4-b9ea4be91144): created successfully Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc456ce-e1f3-4530-8cc4-ef69f65314ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (7e2c83dc-d7f1-434d-ae49-407648b22148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:14 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0bfafa3c-6e1e-4871-99ae-e57f97125ae0 tempest-ProjectReaderTests-1366321205 None] Created volume successfully. Jul 11 04:21:14 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:14 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:14 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-75242555-d59d-466a-8e92-553948932ff3" returned: 0 in 0.784s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-75242555-d59d-466a-8e92-553948932ff3" released by "delete_volume" :: held 1.651s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['e5837d72-e224-40d1-93f8-d042ed3de91e', '33e9292a-ea05-4c40-845b-3cbcdaa55efe', 'e8386420-b0dd-42ae-a939-7f6cf33ed262', '2d02a31e-9e28-44f1-b751-22469602bb3a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:14 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.776s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:14 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 1073741824" returned: 0 in 0.915s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:15 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:15 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:15 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 Jul 11 04:21:15 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-fcfe34fc-db96-4727-93ff-235c4f8e2e19-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-fcfe34fc-db96-4727-93ff-235c4f8e2e19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-fcfe34fc-db96-4727-93ff-235c4f8e2e19" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-fcfe34fc-db96-4727-93ff-235c4f8e2e19" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d505b-a8f2-4275-a499-dc3b2a18eb53]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:15 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 Jul 11 04:21:15 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:15 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:15 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.091s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340680153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:10Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Creating volume cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:15 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.731s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5809ad84-55a6-4c76-b406-2fc03059864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:15 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 1073741824 Jul 11 04:21:15 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8724492d-ba0d-43d1-8233-1af7fceba0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleted volume successfully. Jul 11 04:21:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Volume volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 (b700efcc-832c-4ad8-9dc5-73e493c8d4e4): created successfully Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8724492d-ba0d-43d1-8233-1af7fceba0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Flow 'volume_create_manager' (98e572b3-dd5c-49d2-97f5-064e89ad6cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b5e4fb8f-ac16-4db3-8ea4-88fe5c3b63f0 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-75242555-d59d-466a-8e92-553948932ff3-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c98fcea8-2e8e-48ff-8421-210102cf53c3 tempest-CinderUnicodeTest-820278581 None] Created volume successfully. Jul 11 04:21:16 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19" returned: 0 in 0.794s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:16 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19 Jul 11 04:21:16 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:16 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 1073741824" returned: 0 in 1.000s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:16 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 Jul 11 04:21:16 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:16 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-fcfe34fc-db96-4727-93ff-235c4f8e2e19" returned: 0 in 0.665s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-fcfe34fc-db96-4727-93ff-235c4f8e2e19" released by "delete_volume" :: held 1.511s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['890ee82b-2cb2-43c5-aecd-41a65b5f7882', '56d8edff-eb9a-4543-8062-87c1bd8f9e97', 'b4b63d07-55f0-4c8f-9d51-9a6b0f456885', 'eabf9cd2-f31f-43d4-b10c-22bde575b265'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:17 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:17 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:17 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.890s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f50ee6b-0921-441e-bd60-102f39bf2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123859f6-09a0-4b09-b64b-9b5052a7bb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Creating offline snapshot 7635c67f-10a4-4a23-9fb3-02a2639070e3 of volume 8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:21:17 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Volume volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 (cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0): created successfully Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (123859f6-09a0-4b09-b64b-9b5052a7bb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (f8d541b7-ea11-44fe-9c01-6319a4634c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[be936b7a-6794-41d2-9c55-a2d819fd7383]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:17 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d70485b3-3280-47e8-95ce-658f68756794 tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:17 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 Jul 11 04:21:17 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0b674-9be2-470c-bc21-80d8d725df68]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:17 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.759s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:17 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleted volume successfully. Jul 11 04:21:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-35b92d34-2d13-48a3-b65e-b1c100c67a75 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-fcfe34fc-db96-4727-93ff-235c4f8e2e19-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:17 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd Jul 11 04:21:17 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:18 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144" returned: 0 in 0.884s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:18 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 1G Jul 11 04:21:18 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:18 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd" returned: 0 in 0.819s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:18 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd Jul 11 04:21:18 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:19 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 1G" returned: 0 in 0.828s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:19 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:19 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 Jul 11 04:21:19 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd" released by "delete_volume" :: held 1.516s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['fe54b1d4-199a-465f-9713-32a87b01281c', '7e6dd87f-2921-4018-8de8-c4914ba30654', '10a55013-c15b-42f0-b2f9-6c9d104eb063', 'ea4fa378-8057-4864-8f24-a0b47d379082'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:19 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:19 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-511af89e-8027-4929-8d09-4959a171df63-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:19 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-511af89e-8027-4929-8d09-4959a171df63-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3" returned: 0 in 0.718s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:19 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 is being set with open permissions: ugo+rw Jul 11 04:21:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:19 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 Jul 11 04:21:19 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-511af89e-8027-4929-8d09-4959a171df63" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-511af89e-8027-4929-8d09-4959a171df63" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf29e4b-e62f-4b62-a726-b9571a0c1224]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:20 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.736s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleted volume successfully. Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1bc6d9e-5c4e-4788-8ff9-373a3cfbde38 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-1d020cfb-81b7-4b47-a7d4-530fee2cf3dd-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:20 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 Jul 11 04:21:20 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:20 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:20 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info Jul 11 04:21:20 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:20 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63" returned: 0 in 0.793s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:20 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63 Jul 11 04:21:20 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:21 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info" returned: 0 in 0.693s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:21 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info is being set with open permissions: ugo+rw Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:21 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info Jul 11 04:21:21 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:21 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-511af89e-8027-4929-8d09-4959a171df63" returned: 0 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-511af89e-8027-4929-8d09-4959a171df63" released by "delete_volume" :: held 1.524s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['6f4919d1-cf9e-4c39-a107-ff66f25d2885', '87e6f580-4f26-4a16-a7bf-f5ef0d2598e4', 'a2c8eb0c-2b60-4ba0-9c67-182cafb22e88', 'f9dd2b5f-ac90-4f4d-b027-52669a26886d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:21 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:21 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:22 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.info" returned: 0 in 0.671s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.660s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.486s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Creating offline snapshot f65e9925-dfd4-41c9-bde5-3a54aa1da802 of volume b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:21:22 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2f167308-83d7-4b5c-ade2-8cf922631b3e tempest-ProjectReaderTests-1366321205 None] Create snapshot completed successfully Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a66056-0470-4487-944f-cf16288dc458]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-1244bee9-2124-43e1-a9f5-580c6b25f187-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-1244bee9-2124-43e1-a9f5-580c6b25f187-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-1244bee9-2124-43e1-a9f5-580c6b25f187" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-1244bee9-2124-43e1-a9f5-580c6b25f187" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d0255d-50ba-422a-bf73-9c39a094ca64]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:22 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 Jul 11 04:21:22 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:22 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.701s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:22 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 Jul 11 04:21:22 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:22 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleted volume successfully. Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f5bd4a07-6a5c-4167-a70d-87a3f85c96b7 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-511af89e-8027-4929-8d09-4959a171df63-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-7635c67f-10a4-4a23-9fb3-02a2639070e3-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-7635c67f-10a4-4a23-9fb3-02a2639070e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-8516d875-ce23-4e60-a2d4-b9ea4be91144" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-8516d875-ce23-4e60-a2d4-b9ea4be91144" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-7635c67f-10a4-4a23-9fb3-02a2639070e3" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-7635c67f-10a4-4a23-9fb3-02a2639070e3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Deleting offline snapshot 7635c67f-10a4-4a23-9fb3-02a2639070e3 of volume 8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:22 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] snapshot_file for this snap is: volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" returned: 0 in 0.845s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c095ecb-ae37-4682-a3ce-cf29ee2ec0fd]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:23 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 1G Jul 11 04:21:23 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:23 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187" returned: 0 in 0.817s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:23 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 Jul 11 04:21:23 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:23 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187 Jul 11 04:21:23 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:23 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-1244bee9-2124-43e1-a9f5-580c6b25f187" returned: 0 in 0.663s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-1244bee9-2124-43e1-a9f5-580c6b25f187" released by "delete_volume" :: held 1.525s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:23 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8516d875-ce23-4e60-a2d4-b9ea4be91144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f7d0c-cfb5-4669-9708-9e9dec335500]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['ca2c0eac-0027-4ace-b315-26d8978cad61', '63bb40af-d358-4638-9d4a-a0cc10c0bc17', '4a5baa4f-f9a3-4bdd-91f9-e1c6acd84b16', '709f449c-d9ae-4f2e-af3e-21f910d03dd6'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:23 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 1G" returned: 0 in 0.945s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:23 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 Jul 11 04:21:23 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:23 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 Jul 11 04:21:23 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:23 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:24 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-26ab324d-c88a-4268-ba27-a17744f17ac6-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-26ab324d-c88a-4268-ba27-a17744f17ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-4f2a3566-c457-421f-8b94-608372cf3230" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-4f2a3566-c457-421f-8b94-608372cf3230" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-26ab324d-c88a-4268-ba27-a17744f17ac6" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-26ab324d-c88a-4268-ba27-a17744f17ac6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleting offline snapshot 26ab324d-c88a-4268-ba27-a17744f17ac6 of volume 4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] snapshot_file for this snap is: volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cefc53-b64f-41d3-b641-4007bbf59bb3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:24 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.683s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:24 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleted volume successfully. Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7f2d5a5e-4794-447d-a82b-600281e3d9f8 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-1244bee9-2124-43e1-a9f5-580c6b25f187-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:24 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 Jul 11 04:21:24 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:24 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802" returned: 0 in 0.808s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:24 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 is being set with open permissions: ugo+rw Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:24 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144" returned: 0 in 0.925s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:24 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 Jul 11 04:21:24 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:24 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 Jul 11 04:21:24 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:25 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:25 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802" returned: 0 in 0.692s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6" returned: 0 in 0.858s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f2a3566-c457-421f-8b94-608372cf3230(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0099ac5-8c71-4f6c-8dd7-e3a2344668dc]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:25 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info Jul 11 04:21:25 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:25 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 Jul 11 04:21:25 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:25 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3" returned: 0 in 0.883s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:25 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3 Jul 11 04:21:25 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:26 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info" returned: 0 in 0.715s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:26 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info is being set with open permissions: ugo+rw Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:26 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info Jul 11 04:21:26 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:26 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144.7635c67f-10a4-4a23-9fb3-02a2639070e3" returned: 0 in 0.739s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:26 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230" returned: 0 in 0.944s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-7635c67f-10a4-4a23-9fb3-02a2639070e3" released by "_delete_snapshot" :: held 3.483s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-8516d875-ce23-4e60-a2d4-b9ea4be91144" released by "delete_snapshot" :: held 3.515s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:26 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 Jul 11 04:21:26 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Created reservations ['02cc7da2-293d-4c5d-b133-46324218365a', '702f53f7-bb77-4639-8383-f72ce8ae076a', 'ca555685-71c0-4df4-b075-09d5e022b72e', '813e068f-6472-4b99-b11e-2d9bee810584'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Delete snapshot completed successfully. Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94a45615-94d9-47e0-a282-352355a6cc51 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-7635c67f-10a4-4a23-9fb3-02a2639070e3-delete_snapshot" released by "delete_snapshot" :: held 3.740s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:26 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.info" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.895s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.839s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Creating offline snapshot d1c83f49-3f71-493b-8628-74099516a600 of volume cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:21:27 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-710b4ec8-0347-4ddc-bba0-e050da93feb1 tempest-CinderUnicodeTest-820278581 None] Create snapshot completed successfully Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e00ed9-b817-4b86-b385-e822697fcf48]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-8516d875-ce23-4e60-a2d4-b9ea4be91144-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-8516d875-ce23-4e60-a2d4-b9ea4be91144-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:27 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 Jul 11 04:21:27 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-8516d875-ce23-4e60-a2d4-b9ea4be91144" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-8516d875-ce23-4e60-a2d4-b9ea4be91144" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54c3b7f-a512-4da3-9c57-c1b6506c2d5c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:27 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6" returned: 0 in 0.936s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:27 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6 Jul 11 04:21:27 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:27 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 Jul 11 04:21:27 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:27 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" returned: 0 in 0.899s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:27 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 1G Jul 11 04:21:27 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-f65e9925-dfd4-41c9-bde5-3a54aa1da802-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:28 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230.26ab324d-c88a-4268-ba27-a17744f17ac6" returned: 0 in 0.786s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-f65e9925-dfd4-41c9-bde5-3a54aa1da802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-quobyte-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-26ab324d-c88a-4268-ba27-a17744f17ac6" released by "_delete_snapshot" :: held 3.678s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-quobyte-f65e9925-dfd4-41c9-bde5-3a54aa1da802" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-4f2a3566-c457-421f-8b94-608372cf3230" released by "delete_snapshot" :: held 3.710s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:28 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144" returned: 0 in 0.908s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:28 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144 Jul 11 04:21:28 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-f65e9925-dfd4-41c9-bde5-3a54aa1da802" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Deleting offline snapshot f65e9925-dfd4-41c9-bde5-3a54aa1da802 of volume b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] snapshot_file for this snap is: volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b31512-f031-4a6f-826a-2c1dde70c7fd]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['0dcc71cd-ac2c-4ae7-9e86-05d4309df53b', '21cb74cf-0c1b-4a2a-9d48-b6a5c057a61e', 'f337571d-69e5-42a9-9fd1-54b90a933111', '15bc58c4-68f3-4e81-9444-84d9f97a2e1a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Delete snapshot completed successfully. Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f0920545-0291-497d-8b5f-6d837f8fac82 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-26ab324d-c88a-4268-ba27-a17744f17ac6-delete_snapshot" released by "delete_snapshot" :: held 3.942s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:28 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 Jul 11 04:21:28 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-4f2a3566-c457-421f-8b94-608372cf3230-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-4f2a3566-c457-421f-8b94-608372cf3230-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "cinder-quobyte-4f2a3566-c457-421f-8b94-608372cf3230" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-4f2a3566-c457-421f-8b94-608372cf3230" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dda64c-33c3-4db4-a569-1eb18815ed0d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:29 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 1G" returned: 0 in 1.071s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:29 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 Jul 11 04:21:29 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:29 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 Jul 11 04:21:29 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:29 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8516d875-ce23-4e60-a2d4-b9ea4be91144" returned: 0 in 0.877s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-8516d875-ce23-4e60-a2d4-b9ea4be91144" released by "delete_volume" :: held 1.865s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Created reservations ['5df17431-64dd-4e87-9256-8526acc366d9', '9c50c0c5-146b-4254-8d55-b435ac08a98c', '502349cc-9de0-407e-8b4b-791bdd2fb084', '3218fb1d-d053-496e-b6bb-e5617cf8fcb4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:29 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802" returned: 0 in 1.021s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:29 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:29 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b5a4dc-6c9a-4a3d-a91d-a17dd967ccb7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:29 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 Jul 11 04:21:29 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:29 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600" returned: 0 in 0.974s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:30 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 is being set with open permissions: ugo+rw Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:30 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 Jul 11 04:21:30 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:30 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230" returned: 0 in 1.155s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:30 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230 Jul 11 04:21:30 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (7d2f5eeb-4249-4321-85bf-2e64e17f8ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe490802-c74c-467b-a119-0edddccd2d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:30 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe490802-c74c-467b-a119-0edddccd2d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951865298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d059e46-a794-4390-9543-bdd155d94f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:30Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5b2292-e609-40d7-a1b7-f5dc5856fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5b2292-e609-40d7-a1b7-f5dc5856fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785c269c-0a33-4493-a47f-a0017581f262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785c269c-0a33-4493-a47f-a0017581f262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d059e46-a794-4390-9543-bdd155d94f60', 'volume_name': 'volume-7d059e46-a794-4390-9543-bdd155d94f60', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5affbbd-536e-47d0-87cb-aa53a89d90c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5affbbd-536e-47d0-87cb-aa53a89d90c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d5d80d-4109-4d52-8927-d62a9c5d8648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:30 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Volume 7d059e46-a794-4390-9543-bdd155d94f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d059e46-a794-4390-9543-bdd155d94f60', 'volume_size': 1} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.920s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:30 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Deleted volume successfully. Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-282bf3c2-d726-4aa5-a837-7a9555445cc3 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-8516d875-ce23-4e60-a2d4-b9ea4be91144-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:30 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" returned: 0 in 1.146s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:30 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 Jul 11 04:21:30 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:30 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600" returned: 0 in 0.743s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:30 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info Jul 11 04:21:30 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:30 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-4f2a3566-c457-421f-8b94-608372cf3230" returned: 0 in 0.815s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:30 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-quobyte-4f2a3566-c457-421f-8b94-608372cf3230" released by "delete_volume" :: held 2.039s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Created reservations ['7e89ea6e-11a4-4187-804b-e3ddc3253a63', '81f6eabe-e9fe-487b-81cc-932c745ebe66', '72b8139a-0230-4de9-8544-17c70f721aa5', '61422f26-c23f-4bcb-abb8-7468c05f2621'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:31 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:31 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:31 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802" returned: 0 in 0.860s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:31 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802 Jul 11 04:21:31 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:31 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info" returned: 0 in 0.801s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:31 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info is being set with open permissions: ugo+rw Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:31 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info Jul 11 04:21:31 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:31 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.667s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:31 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Deleted volume successfully. Jul 11 04:21:31 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-a1695e84-eb70-43d8-a90a-acdea388f4a2 tempest-CreateVolumesFromSnapshotTest-1040656064 None] Lock "cinder-4f2a3566-c457-421f-8b94-608372cf3230-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:32 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4.f65e9925-dfd4-41c9-bde5-3a54aa1da802" returned: 0 in 0.698s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-f65e9925-dfd4-41c9-bde5-3a54aa1da802" released by "_delete_snapshot" :: held 3.863s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" released by "delete_snapshot" :: held 3.919s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Created reservations ['a93ace2c-6c3a-439c-830e-d6432e9e9037', 'd831ddec-5e29-4cb3-a06e-0ef569e23265', '3ddc2d81-61d9-4784-8b11-711ff72431c9', 'c2251b68-afa9-423c-be28-834f961e75bf'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Delete snapshot completed successfully. Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-da7679c4-2342-4bd5-b7e6-ee8981543a90 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-f65e9925-dfd4-41c9-bde5-3a54aa1da802-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:32 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.info" returned: 0 in 0.747s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.351s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951865298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d059e46-a794-4390-9543-bdd155d94f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:30Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Creating volume 7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:32 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:32 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 1073741824 Jul 11 04:21:32 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-3d68e156-f016-46aa-a83b-3605e60e5fb1 tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-b700efcc-832c-4ad8-9dc5-73e493c8d4e4-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Lock "cinder-b700efcc-832c-4ad8-9dc5-73e493c8d4e4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-quobyte-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25dd61a-1136-4131-805d-bc9818108cc0]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:32 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 Jul 11 04:21:32 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-d1c83f49-3f71-493b-8628-74099516a600-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Lock "cinder-d1c83f49-3f71-493b-8628-74099516a600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-d1c83f49-3f71-493b-8628-74099516a600" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-d1c83f49-3f71-493b-8628-74099516a600" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot d1c83f49-3f71-493b-8628-74099516a600 of volume cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fcb408-2a85-41b5-a35b-678c50345fe6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:33 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 Jul 11 04:21:33 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:33 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 1073741824" returned: 0 in 1.010s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:33 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 Jul 11 04:21:33 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:33 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" returned: 0 in 1.094s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:33 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4 Jul 11 04:21:33 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:33 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600" returned: 0 in 0.980s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ba9aa-814c-4af6-bb2b-ad1ce31c7897]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:34 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 Jul 11 04:21:34 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:34 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60" returned: 0 in 0.785s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d5d80d-4109-4d52-8927-d62a9c5d8648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d059e46-a794-4390-9543-bdd155d94f60', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474bc858-9f6a-40cb-882c-778bf3840a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:34 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Volume volume-7d059e46-a794-4390-9543-bdd155d94f60 (7d059e46-a794-4390-9543-bdd155d94f60): created successfully Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474bc858-9f6a-40cb-882c-778bf3840a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (7d2f5eeb-4249-4321-85bf-2e64e17f8ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-860d1bdd-c469-4739-b21a-6981936ff50d tempest-ProjectReaderTests-1366321205 None] Created volume successfully. Jul 11 04:21:34 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" returned: 0 in 0.803s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-b700efcc-832c-4ad8-9dc5-73e493c8d4e4" released by "delete_volume" :: held 1.970s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Created reservations ['d28ba46a-7e6e-4a16-9291-abde5bb0980d', '003919d4-9ce9-44ed-8c8f-0eabe06339ba', '90f2136d-fb6c-40ca-bcee-8f9c924c7824', 'bcfbc162-9f46-4c4f-96a0-7f6cf8f0184d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:34 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:34 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-5326d713-ed2b-4edd-8e72-79fa51dc5bf8-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-5326d713-ed2b-4edd-8e72-79fa51dc5bf8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "cinder-quobyte-5326d713-ed2b-4edd-8e72-79fa51dc5bf8" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-5326d713-ed2b-4edd-8e72-79fa51dc5bf8" acquired by "delete_volume" :: waited 0.032s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:34 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" returned: 0 in 0.993s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f063f7-1be1-4241-9968-8c922d44206a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:35 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 Jul 11 04:21:35 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:35 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 Jul 11 04:21:35 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.744s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:35 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:35 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Deleted volume successfully. Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c6f3bc1b-a2e0-41e6-a132-a5ab60d72f1a tempest-CinderUnicodeTest-820278581 None] Lock "cinder-b700efcc-832c-4ad8-9dc5-73e493c8d4e4-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Creating offline snapshot cb3db85f-95fc-4e99-8571-517840b40a72 of volume 7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ba7a7-7873-4ac6-9f96-75197388e09a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:35 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 Jul 11 04:21:35 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:36 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600" returned: 0 in 1.069s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:36 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600 Jul 11 04:21:36 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:36 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8" returned: 0 in 1.118s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:36 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8 Jul 11 04:21:36 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:36 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60" returned: 0 in 0.853s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:36 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 1G Jul 11 04:21:36 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:36 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0.d1c83f49-3f71-493b-8628-74099516a600" returned: 0 in 0.750s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:36 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-5326d713-ed2b-4edd-8e72-79fa51dc5bf8" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-d1c83f49-3f71-493b-8628-74099516a600" released by "_delete_snapshot" :: held 3.955s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-quobyte-5326d713-ed2b-4edd-8e72-79fa51dc5bf8" released by "delete_volume" :: held 1.918s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" released by "delete_snapshot" :: held 4.005s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Created reservations ['42706511-ec96-4936-a1f9-db6d0b3f1cdf', '5664e43c-ae86-4d96-b262-7a6e12bdeaaa', 'a3bef453-79e6-45e8-bdb6-c2e062f1b636', '4cd3787f-c0b7-4437-bdea-7594fa8675cd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:36 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Created reservations ['de687c95-7d7d-4a31-bcad-9cf92f30330f', 'f1c4d60d-a431-4433-828c-7ef1705c782a', '95f8e106-8d54-4373-bd35-283cbf29f4a9', '93ea038f-4d39-429d-9fb2-b1177cbf701b'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:37 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:37 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:37 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1b375341-4573-4b28-8870-5d9a1cfaf925 tempest-ProjectMemberTests-476116560 None] Lock "cinder-d1c83f49-3f71-493b-8628-74099516a600-delete_snapshot" released by "delete_snapshot" :: held 4.281s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Lock "cinder-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecbfcaa-85a2-45a1-818a-53865c5fb924]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:37 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 Jul 11 04:21:37 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:37 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 1G" returned: 0 in 1.142s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d059e46-a794-4390-9543-bdd155d94f60 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:37 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d059e46-a794-4390-9543-bdd155d94f60 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 Jul 11 04:21:37 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:37 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.863s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:37 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Deleted volume successfully. Jul 11 04:21:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-90365407-8ab5-44a0-98a4-5a88408cef64 tempest-CinderUnicodeTest-820278581 None] Lock "cinder-5326d713-ed2b-4edd-8e72-79fa51dc5bf8-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:38 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" returned: 0 in 1.185s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:38 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d059e46-a794-4390-9543-bdd155d94f60 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72" returned: 0 in 0.891s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:38 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 is being set with open permissions: ugo+rw Jul 11 04:21:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:38 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0 Jul 11 04:21:38 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:38 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 Jul 11 04:21:38 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:39 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" returned: 0 in 0.818s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0" released by "delete_volume" :: held 2.090s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:39 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72" returned: 0 in 0.949s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Created reservations ['708c07b5-10ab-4b4f-9662-4fe2b7c12a1d', 'b13c7369-b7f6-4825-967a-93b4df841a6a', '1e3e8219-08a9-464c-912b-af580ace53cc', '359022cf-faea-4fa8-8748-c8e36e8c98a4'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:39 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info Jul 11 04:21:39 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:39 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:39 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:40 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.733s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:40 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:40 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info" returned: 0 in 0.877s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:40 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info is being set with open permissions: ugo+rw Jul 11 04:21:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:21:40 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info Jul 11 04:21:40 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-2344dc9d-3a6f-4b21-950f-b64529651993 tempest-ProjectMemberTests-476116560 None] Lock "cinder-cdb6ea1d-9b08-4c37-9b2e-805827ef7bf0-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (53743202-446b-4ef2-be87-5376ac2f5fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a674270-f6ef-4c86-80f4-9eb71568c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:41 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a674270-f6ef-4c86-80f4-9eb71568c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563341658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b922903-976c-41b0-a7f6-2fd56b8ab062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:41Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2a7421-520a-4324-be3d-88af391269f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2a7421-520a-4324-be3d-88af391269f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932bf76f-a671-44a0-911c-8e8199a8892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932bf76f-a671-44a0-911c-8e8199a8892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b922903-976c-41b0-a7f6-2fd56b8ab062', 'volume_name': 'volume-7b922903-976c-41b0-a7f6-2fd56b8ab062', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8903afa3-f9c4-488b-9229-6087a5ef80a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8903afa3-f9c4-488b-9229-6087a5ef80a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c107e9e8-ab52-4642-bf9b-b3949f36da43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:41 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Volume 7b922903-976c-41b0-a7f6-2fd56b8ab062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b922903-976c-41b0-a7f6-2fd56b8ab062', 'volume_size': 1} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.info" returned: 0 in 0.900s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.727s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563341658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b922903-976c-41b0-a7f6-2fd56b8ab062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:41Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Creating volume 7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:41 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:41 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 1073741824 Jul 11 04:21:41 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:41 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-507d5e7b-6fe0-4fee-a3ec-cd6281185c90 tempest-ProjectReaderTests-1366321205 None] Create snapshot completed successfully Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-5b8b83c4-df7b-45ed-b256-1804011b22ca tempest-ProjectAdminTests-33029995 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87437) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 11 04:21:42 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 1073741824" returned: 0 in 0.949s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:42 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 Jul 11 04:21:42 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-cb3db85f-95fc-4e99-8571-517840b40a72-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-cb3db85f-95fc-4e99-8571-517840b40a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-7d059e46-a794-4390-9543-bdd155d94f60" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-7d059e46-a794-4390-9543-bdd155d94f60" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-cb3db85f-95fc-4e99-8571-517840b40a72" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-cb3db85f-95fc-4e99-8571-517840b40a72" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Deleting offline snapshot cb3db85f-95fc-4e99-8571-517840b40a72 of volume 7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] snapshot_file for this snap is: volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[52845576-9f90-4eb9-98d3-c2f47001b9ad]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:42 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 Jul 11 04:21:42 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:43 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062" returned: 0 in 0.818s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c107e9e8-ab52-4642-bf9b-b3949f36da43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b922903-976c-41b0-a7f6-2fd56b8ab062', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa7f732-3950-40a8-8802-888336942f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:43 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Volume volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 (7b922903-976c-41b0-a7f6-2fd56b8ab062): created successfully Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa7f732-3950-40a8-8802-888336942f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (53743202-446b-4ef2-be87-5376ac2f5fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:43 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-eea75ddb-f1cc-4b04-a103-dddc46d94467 tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:21:43 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72" returned: 0 in 0.805s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d059e46-a794-4390-9543-bdd155d94f60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ae8f6-cb8c-4027-aaa5-44fd8f9731de]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:43 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 Jul 11 04:21:43 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Creating offline snapshot 27091c59-1660-4fac-936a-caa48c53a7c1 of volume 7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a180b06f-af1d-4ee4-9651-8edd5da19d10]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:44 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 Jul 11 04:21:44 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:44 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60" returned: 0 in 0.913s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:44 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 Jul 11 04:21:44 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:45 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062" returned: 0 in 0.997s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:45 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 1G Jul 11 04:21:45 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:45 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72" returned: 0 in 0.932s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:45 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72 Jul 11 04:21:45 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:46 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60.cb3db85f-95fc-4e99-8571-517840b40a72" returned: 0 in 0.737s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-cb3db85f-95fc-4e99-8571-517840b40a72" released by "_delete_snapshot" :: held 3.536s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-7d059e46-a794-4390-9543-bdd155d94f60" released by "delete_snapshot" :: held 3.575s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:46 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 1G" returned: 0 in 1.044s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:46 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 Jul 11 04:21:46 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Created reservations ['f2b28c28-fbfd-493e-8aae-03ee4d59aa3e', '7091e579-2b1a-4ed7-ba6f-c5a9a91026c3', '971f89b7-9485-43fc-bf77-70457686f157', '1067f13e-54a2-4d69-a1b3-4e4d7ed861b5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:46 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Delete snapshot completed successfully. Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cd5b3e8c-bfb5-4e8a-922f-6752261b4911 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-cb3db85f-95fc-4e99-8571-517840b40a72-delete_snapshot" released by "delete_snapshot" :: held 3.787s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:46 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-7d059e46-a794-4390-9543-bdd155d94f60-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-7d059e46-a794-4390-9543-bdd155d94f60-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:47 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1" returned: 0 in 0.872s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:47 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 is being set with open permissions: ugo+rw Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-7d059e46-a794-4390-9543-bdd155d94f60" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-7d059e46-a794-4390-9543-bdd155d94f60" acquired by "delete_volume" :: waited 0.023s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:47 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 Jul 11 04:21:47 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80db7bb-f386-40b5-b507-aafaac019129]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:47 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 Jul 11 04:21:47 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:47 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1" returned: 0 in 0.775s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:47 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info Jul 11 04:21:47 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:48 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60" returned: 0 in 0.940s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:48 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60 Jul 11 04:21:48 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:48 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info" returned: 0 in 0.854s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:48 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info is being set with open permissions: ugo+rw Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:48 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info Jul 11 04:21:48 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:48 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7d059e46-a794-4390-9543-bdd155d94f60" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-7d059e46-a794-4390-9543-bdd155d94f60" released by "delete_volume" :: held 1.740s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:48 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Created reservations ['549ac479-8baa-4a1c-ad74-e14d21e8f8de', '8332d4af-6520-419d-ab53-0028d231ac5e', '21bed950-5b9a-4b27-900c-6892a65f3ec1', '29ecbe71-9767-435f-83dc-b5464416e42a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:49 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:49 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:49 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.info" returned: 0 in 0.901s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.585s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-8da01ceb-de2f-4e40-9856-e45d6712e251 tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (bdf48527-4e63-49f2-97b0-6d61b7f2d63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:50 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f414b455-f533-43fc-a884-459d4053d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 1.060s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:50 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Deleted volume successfully. Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f414b455-f533-43fc-a884-459d4053d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4796864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b0be98-b708-4234-b805-323c59028f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:50Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31c5048-f8c7-412b-9697-78d39c3b4981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31c5048-f8c7-412b-9697-78d39c3b4981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1686a16f-b05c-4b16-82bc-6538abcffd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1686a16f-b05c-4b16-82bc-6538abcffd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b0be98-b708-4234-b805-323c59028f17', 'volume_name': 'volume-10b0be98-b708-4234-b805-323c59028f17', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c93a02-41fe-4e8e-bc27-b73d784e28c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7c93a02-41fe-4e8e-bc27-b73d784e28c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001acad8-708d-4c93-81fd-06cad0579572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:50 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Volume 10b0be98-b708-4234-b805-323c59028f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b0be98-b708-4234-b805-323c59028f17', 'volume_size': 1} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4796864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b0be98-b708-4234-b805-323c59028f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:50Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Creating volume 10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:50 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-6b287bec-e4ef-44ab-bb9d-dde9c9830185 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-7d059e46-a794-4390-9543-bdd155d94f60-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:50 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 1073741824 Jul 11 04:21:50 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-27091c59-1660-4fac-936a-caa48c53a7c1-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Lock "cinder-27091c59-1660-4fac-936a-caa48c53a7c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-7b922903-976c-41b0-a7f6-2fd56b8ab062" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b922903-976c-41b0-a7f6-2fd56b8ab062" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-27091c59-1660-4fac-936a-caa48c53a7c1" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-27091c59-1660-4fac-936a-caa48c53a7c1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot 27091c59-1660-4fac-936a-caa48c53a7c1 of volume 7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f04a4-a42f-4a58-b078-fbcc2a7bd826]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:50 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 Jul 11 04:21:50 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:51 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 1073741824" returned: 0 in 1.088s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:51 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 Jul 11 04:21:51 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:51 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1" returned: 0 in 0.984s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:51 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b922903-976c-41b0-a7f6-2fd56b8ab062(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:51 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4047fd3c-4e07-4440-a498-e6261760cdb7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:51 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 Jul 11 04:21:51 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:52 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17" returned: 0 in 0.748s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001acad8-708d-4c93-81fd-06cad0579572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b0be98-b708-4234-b805-323c59028f17', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee0f11e-6ea9-48d1-97c7-449a60beb293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:52 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Volume volume-10b0be98-b708-4234-b805-323c59028f17 (10b0be98-b708-4234-b805-323c59028f17): created successfully Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee0f11e-6ea9-48d1-97c7-449a60beb293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (bdf48527-4e63-49f2-97b0-6d61b7f2d63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:52 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0d66cb07-21c9-471f-ac53-f4ebe4b5d92f tempest-ProjectReaderTests-1366321205 None] Created volume successfully. Jul 11 04:21:52 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062" returned: 0 in 0.912s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:52 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 Jul 11 04:21:52 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=134,cinder:UPDATE=186,cinder:INSERT=53,cinder:DELETE=22 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Creating offline snapshot 1fa46bfb-db21-41ba-89dd-0fcba7be4ccf of volume 10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9e608-74f2-4191-82af-6977b01740f3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:53 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1" returned: 0 in 0.938s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:53 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1 Jul 11 04:21:53 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:53 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 Jul 11 04:21:53 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:54 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062.27091c59-1660-4fac-936a-caa48c53a7c1" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-27091c59-1660-4fac-936a-caa48c53a7c1" released by "_delete_snapshot" :: held 3.667s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b922903-976c-41b0-a7f6-2fd56b8ab062" released by "delete_snapshot" :: held 3.699s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Created reservations ['92580ba0-c2ad-413b-b261-c238c3655009', 'aaf64a3d-aa0c-4cb1-8c61-53218eb251e3', '592deec4-f044-424a-9d81-98dd9b28522e', 'ea0c2663-5e22-406b-8cab-ca7d2b1e91da'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:54 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17" returned: 0 in 0.834s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:54 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf 1G Jul 11 04:21:54 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:54 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-80c970d3-b5d0-4222-860e-e0a2ac20bec9 tempest-ProjectMemberTests-476116560 None] Lock "cinder-27091c59-1660-4fac-936a-caa48c53a7c1-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-7b922903-976c-41b0-a7f6-2fd56b8ab062-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Lock "cinder-7b922903-976c-41b0-a7f6-2fd56b8ab062-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-7b922903-976c-41b0-a7f6-2fd56b8ab062" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b922903-976c-41b0-a7f6-2fd56b8ab062" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5975455-49b8-4a3d-b7a2-b8e92a9b3ea7]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:55 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 Jul 11 04:21:55 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:55 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf 1G" returned: 0 in 0.827s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b0be98-b708-4234-b805-323c59028f17 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:55 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b0be98-b708-4234-b805-323c59028f17 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf Jul 11 04:21:55 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:55 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062" returned: 0 in 0.781s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:55 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062 Jul 11 04:21:55 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:55 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10b0be98-b708-4234-b805-323c59028f17 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" returned: 0 in 0.690s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:55 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf is being set with open permissions: ugo+rw Jul 11 04:21:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:55 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf Jul 11 04:21:55 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:56 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b922903-976c-41b0-a7f6-2fd56b8ab062" returned: 0 in 0.637s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b922903-976c-41b0-a7f6-2fd56b8ab062" released by "delete_volume" :: held 1.475s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=161,cinder:UPDATE=199,cinder:INSERT=49,cinder:DELETE=10 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Created reservations ['77fe7081-4753-407a-a676-de7ea5075644', 'eafed2bc-a766-45af-a886-99dad7cb0893', 'd4760b89-8e5a-44bd-b5c6-bdb9e05928b2', 'e4e52f79-c852-4f13-a388-a9e0d65609f5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:56 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:21:56 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:56 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" returned: 0 in 0.708s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:56 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info Jul 11 04:21:56 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:57 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.646s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:21:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0ea5aa06-9867-4e01-8626-32c091853ad2 tempest-ProjectMemberTests-476116560 None] Lock "cinder-7b922903-976c-41b0-a7f6-2fd56b8ab062-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:21:57 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info" returned: 0 in 0.650s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:57 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info is being set with open permissions: ugo+rw Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:57 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info Jul 11 04:21:57 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (998ece06-d01d-4236-9be5-4016d194a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab244164-7175-44dd-9f8b-029f9034a643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab244164-7175-44dd-9f8b-029f9034a643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325401082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b40ab0-cbd1-414b-809a-3a88231ab816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:57Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed42ab7b-dc55-4d0b-b82e-509e6867b7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed42ab7b-dc55-4d0b-b82e-509e6867b7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c130a14-f9e8-48c2-8f9a-71f5d424375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c130a14-f9e8-48c2-8f9a-71f5d424375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b40ab0-cbd1-414b-809a-3a88231ab816', 'volume_name': 'volume-f6b40ab0-cbd1-414b-809a-3a88231ab816', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83bc9b-fc70-4485-a606-c21d77bf2c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab83bc9b-fc70-4485-a606-c21d77bf2c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5ec711-534f-4542-9084-c6394066baeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Volume f6b40ab0-cbd1-414b-809a-3a88231ab816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b40ab0-cbd1-414b-809a-3a88231ab816', 'volume_size': 1} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:57 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.info" returned: 0 in 0.639s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.448s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325401082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b40ab0-cbd1-414b-809a-3a88231ab816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:21:57Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Creating volume f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:21:57 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:21:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:57 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 1073741824 Jul 11 04:21:57 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f20a6ac5-6c5a-44dd-bc0c-d452e824b126 tempest-ProjectReaderTests-1366321205 None] Create snapshot completed successfully Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-1fa46bfb-db21-41ba-89dd-0fcba7be4ccf-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Lock "cinder-1fa46bfb-db21-41ba-89dd-0fcba7be4ccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-10b0be98-b708-4234-b805-323c59028f17" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-10b0be98-b708-4234-b805-323c59028f17" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:21:58 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 1073741824" returned: 0 in 0.810s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Deleting offline snapshot 1fa46bfb-db21-41ba-89dd-0fcba7be4ccf of volume 10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] snapshot_file for this snap is: volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f83a6b-ab3c-4d8e-9629-e4cc785830f3]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:58 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 Jul 11 04:21:58 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:58 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf Jul 11 04:21:58 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:21:59 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816" returned: 0 in 0.629s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5ec711-534f-4542-9084-c6394066baeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b40ab0-cbd1-414b-809a-3a88231ab816', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087b60aa-30f0-4393-8bcc-a48519f533a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:21:59 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Volume volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 (f6b40ab0-cbd1-414b-809a-3a88231ab816): created successfully Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (087b60aa-30f0-4393-8bcc-a48519f533a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (998ece06-d01d-4236-9be5-4016d194a121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:21:59 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0540ec14-e3c3-4527-8f45-1bc050088db8 tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:21:59 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" returned: 0 in 0.776s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10b0be98-b708-4234-b805-323c59028f17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7eabb0-d88d-407a-8ca3-30f6f5de4538]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:21:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:21:59 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 Jul 11 04:21:59 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:00 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17" returned: 0 in 0.733s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:00 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf Jul 11 04:22:00 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Creating offline snapshot d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 of volume f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[666156e0-d582-40dc-8471-55ea1ca2e016]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:01 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 Jul 11 04:22:01 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:01 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" returned: 0 in 0.734s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:01 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf Jul 11 04:22:01 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:01 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:01 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 1G Jul 11 04:22:01 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:01 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17.1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" returned: 0 in 0.703s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-1fa46bfb-db21-41ba-89dd-0fcba7be4ccf" released by "_delete_snapshot" :: held 3.063s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-10b0be98-b708-4234-b805-323c59028f17" released by "delete_snapshot" :: held 3.090s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Created reservations ['a9a6d8a6-ac4f-40c1-8423-370734f9e7ad', 'dbfd4486-f21b-4061-99d1-fd1f080001ce', 'eadbfa29-8607-42c9-9c10-0f628915034e', '950eda27-c4ce-48cc-8dbc-0d24c2429287'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Delete snapshot completed successfully. Jul 11 04:22:01 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-1043629a-a9ab-4c7c-a827-fb56e1dea77f tempest-ProjectReaderTests-1366321205 None] Lock "cinder-1fa46bfb-db21-41ba-89dd-0fcba7be4ccf-delete_snapshot" released by "delete_snapshot" :: held 3.228s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:02 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 1G" returned: 0 in 0.756s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:02 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 Jul 11 04:22:02 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-10b0be98-b708-4234-b805-323c59028f17-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Lock "cinder-10b0be98-b708-4234-b805-323c59028f17-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-10b0be98-b708-4234-b805-323c59028f17" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-10b0be98-b708-4234-b805-323c59028f17" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[114e50fb-d2e8-47da-aeef-ec3283cb1825]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:03 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" returned: 0 in 0.758s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:03 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 is being set with open permissions: ugo+rw Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:03 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 Jul 11 04:22:03 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:03 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 Jul 11 04:22:03 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:03 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" returned: 0 in 0.626s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:03 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info Jul 11 04:22:03 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:03 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17" returned: 0 in 0.819s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:03 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17 Jul 11 04:22:03 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:04 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info" returned: 0 in 0.647s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:04 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info is being set with open permissions: ugo+rw Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:04 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info Jul 11 04:22:04 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:04 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-10b0be98-b708-4234-b805-323c59028f17" returned: 0 in 0.716s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-10b0be98-b708-4234-b805-323c59028f17" released by "delete_volume" :: held 1.598s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Created reservations ['f19b90c0-2156-42b0-9032-ab93faf6c04e', '094a7df5-ae99-4262-be7c-f0d6ba0e5751', '93cfc1a3-ccd1-4770-948e-c7731c6725a4', '920b5a14-40a0-4b17-918f-5c7da9cd5f52'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:04 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:04 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:05 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.info" returned: 0 in 0.639s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.237s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-11cb791a-d243-4499-94e3-5756a31eb08f tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:22:05 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.677s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:05 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Deleted volume successfully. Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-16ab9918-df52-4089-bf27-fdc858d63e6e tempest-ProjectReaderTests-1366321205 None] Lock "cinder-10b0be98-b708-4234-b805-323c59028f17-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (20220217-00b0-438a-b6de-24faa989275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78d5e9a-396d-4413-96f4-5efb8b46999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78d5e9a-396d-4413-96f4-5efb8b46999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914297041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3399ced0-6017-4e87-ba4e-cdce57fa99c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:06Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d0ecac-6e36-47fd-8a36-adc442eb6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d0ecac-6e36-47fd-8a36-adc442eb6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682a6d4d-07a0-45b7-b59a-73cd6574dd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682a6d4d-07a0-45b7-b59a-73cd6574dd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3399ced0-6017-4e87-ba4e-cdce57fa99c5', 'volume_name': 'volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3484381a-d178-48f1-8958-e41b9da7e0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3484381a-d178-48f1-8958-e41b9da7e0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216b4426-1a6a-4221-b960-c34fad1fc210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:05 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Volume 3399ced0-6017-4e87-ba4e-cdce57fa99c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5', 'volume_size': 1} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1914297041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3399ced0-6017-4e87-ba4e-cdce57fa99c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d40511cc6bc47d0a66a574929db2cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:06Z,use_quota=True,user_id='b800b99a71b74f0f82d5d8f57a9b82df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Creating volume 3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:05 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:05 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 1073741824 Jul 11 04:22:05 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-f6b40ab0-cbd1-414b-809a-3a88231ab816" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-f6b40ab0-cbd1-414b-809a-3a88231ab816" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 of volume f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a596bfad-2c07-4b7d-9c81-442899b8cfaa]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:06 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 Jul 11 04:22:06 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:06 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 1073741824" returned: 0 in 0.821s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:06 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 Jul 11 04:22:06 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:06 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" returned: 0 in 0.744s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b40ab0-cbd1-414b-809a-3a88231ab816(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[49be8b89-3309-43a3-98a2-631aa8921335]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:07 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 Jul 11 04:22:07 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:07 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5" returned: 0 in 0.639s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216b4426-1a6a-4221-b960-c34fad1fc210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc46e92-1cb8-4f86-bfda-099bd8637471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Volume volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 (3399ced0-6017-4e87-ba4e-cdce57fa99c5): created successfully Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc46e92-1cb8-4f86-bfda-099bd8637471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Flow 'volume_create_manager' (20220217-00b0-438a-b6de-24faa989275e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ac4fd7d6-a4fa-467e-8729-3f162892032d tempest-ProjectReaderTests-1366321205 None] Created volume successfully. Jul 11 04:22:07 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:07 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 Jul 11 04:22:07 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Creating offline snapshot 29d0ebda-854c-443a-ae7c-304ba264b921 of volume 3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[929b0018-9b39-4538-a32c-ad3ff884d25d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:08 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 Jul 11 04:22:08 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:08 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" returned: 0 in 0.745s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:08 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8 Jul 11 04:22:08 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:08 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:08 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 1G Jul 11 04:22:08 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:09 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816.d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8" released by "_delete_snapshot" :: held 2.967s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-f6b40ab0-cbd1-414b-809a-3a88231ab816" released by "delete_snapshot" :: held 2.995s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Created reservations ['835cff61-f545-46cd-a0a0-42afa0fcf5e3', 'ba129c8b-9b47-426f-9877-262cc3ab07c9', 'fccc9660-b418-40b7-8204-a95000c21939', '6f77d7e3-7a0e-4050-b86c-7e0889bba1d0'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-cb4c9fee-6683-43ba-bc0a-b1c86b4961e6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-d1e5f17d-025c-4c13-a5b7-4c5d8ec00bb8-delete_snapshot" released by "delete_snapshot" :: held 3.134s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-f6b40ab0-cbd1-414b-809a-3a88231ab816-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Lock "cinder-f6b40ab0-cbd1-414b-809a-3a88231ab816-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-f6b40ab0-cbd1-414b-809a-3a88231ab816" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-f6b40ab0-cbd1-414b-809a-3a88231ab816" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[abafdead-4f99-4ae5-827a-6b6d042fafd2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:09 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 1G" returned: 0 in 0.828s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:09 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 Jul 11 04:22:09 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:09 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 Jul 11 04:22:09 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:10 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921" returned: 0 in 0.684s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:10 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 is being set with open permissions: ugo+rw Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:10 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816" returned: 0 in 0.746s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:10 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 Jul 11 04:22:10 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:10 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816 Jul 11 04:22:10 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:10 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-f6b40ab0-cbd1-414b-809a-3a88231ab816" returned: 0 in 0.620s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-f6b40ab0-cbd1-414b-809a-3a88231ab816" released by "delete_volume" :: held 1.425s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Created reservations ['75bf6c29-7fcb-400b-8635-de98264e6128', 'db134e3a-759d-416a-a821-a8a8e1ce82d2', 'a5f7395c-a943-4f07-8066-c673c58fa544', 'e6291e8f-39ab-4d0b-938c-a3ef4dcbb0e5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:10 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921" returned: 0 in 0.704s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:10 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info Jul 11 04:22:10 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:11 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:11 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:11 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info" returned: 0 in 0.631s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:11 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info is being set with open permissions: ugo+rw Jul 11 04:22:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:11 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info Jul 11 04:22:11 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:11 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.650s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:11 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:22:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b304e2db-4220-4eb5-b3dd-4d7dcb676847 tempest-ProjectMemberTests-476116560 None] Lock "cinder-f6b40ab0-cbd1-414b-809a-3a88231ab816-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (7f0c2f34-2d79-44d4-b1fc-1b2cedc4d697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e26f5bf-a086-46be-a80c-c6675f2a3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e26f5bf-a086-46be-a80c-c6675f2a3c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115803114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c673322-2766-4816-a97e-fa1429660413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:12Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8676e9f5-7f29-4486-b6ca-056be3644635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8676e9f5-7f29-4486-b6ca-056be3644635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5710ace3-6ebd-4082-b383-f48f4b3f732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5710ace3-6ebd-4082-b383-f48f4b3f732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c673322-2766-4816-a97e-fa1429660413', 'volume_name': 'volume-8c673322-2766-4816-a97e-fa1429660413', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6450f7fe-0608-40c8-8318-04b66c14b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6450f7fe-0608-40c8-8318-04b66c14b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b504521-0014-4053-8350-5b84cd4e7ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:12 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Volume 8c673322-2766-4816-a97e-fa1429660413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c673322-2766-4816-a97e-fa1429660413', 'volume_size': 1} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:12 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.info" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.311s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.070s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115803114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c673322-2766-4816-a97e-fa1429660413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:12Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Creating volume 8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:12 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:12 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 1073741824 Jul 11 04:22:12 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-702f0251-0b09-4660-92c4-d9fed3138803 tempest-ProjectReaderTests-1366321205 None] Create snapshot completed successfully Jul 11 04:22:13 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 1073741824" returned: 0 in 0.823s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-29d0ebda-854c-443a-ae7c-304ba264b921-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:13 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 Jul 11 04:22:13 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Lock "cinder-29d0ebda-854c-443a-ae7c-304ba264b921-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-3399ced0-6017-4e87-ba4e-cdce57fa99c5" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-3399ced0-6017-4e87-ba4e-cdce57fa99c5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-29d0ebda-854c-443a-ae7c-304ba264b921" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-29d0ebda-854c-443a-ae7c-304ba264b921" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Deleting offline snapshot 29d0ebda-854c-443a-ae7c-304ba264b921 of volume 3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] snapshot_file for this snap is: volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fed6e8e-8393-401c-acb4-0e8ae7a4f8aa]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:13 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 Jul 11 04:22:13 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:13 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413" returned: 0 in 0.624s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b504521-0014-4053-8350-5b84cd4e7ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c673322-2766-4816-a97e-fa1429660413', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5631f65-7ace-4560-b5bc-08d3ea32221c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:13 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Volume volume-8c673322-2766-4816-a97e-fa1429660413 (8c673322-2766-4816-a97e-fa1429660413): created successfully Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5631f65-7ace-4560-b5bc-08d3ea32221c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (7f0c2f34-2d79-44d4-b1fc-1b2cedc4d697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:13 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-44005ca4-d470-4012-bba7-5c38465d2440 tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:22:13 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd677ff4-56cb-4a56-8df3-4f7ec56ee34a]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:14 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 Jul 11 04:22:14 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:14 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:14 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Creating offline snapshot 7096ad37-1a88-456b-86ff-95d37234edcf of volume 8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[d851f5be-0817-461c-aa3a-5e0ff18fe0c9]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:14 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 Jul 11 04:22:14 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:14 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5" returned: 0 in 0.779s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:14 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 Jul 11 04:22:14 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:14 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.717s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:22:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:22:15 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413" returned: 0 in 0.734s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:15 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf 1G Jul 11 04:22:15 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:15 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921" returned: 0 in 0.738s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:15 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921 Jul 11 04:22:15 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:15 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf 1G" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c673322-2766-4816-a97e-fa1429660413 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:15 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c673322-2766-4816-a97e-fa1429660413 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf Jul 11 04:22:15 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:16 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5.29d0ebda-854c-443a-ae7c-304ba264b921" returned: 0 in 0.675s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-29d0ebda-854c-443a-ae7c-304ba264b921" released by "_delete_snapshot" :: held 3.008s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-3399ced0-6017-4e87-ba4e-cdce57fa99c5" released by "delete_snapshot" :: held 3.034s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Created reservations ['13f41cdc-2914-404b-ae77-d684d4f9d7ef', '33eafd4e-8cf5-4426-86df-aafa4610876b', 'a7aa01ca-6c57-4d2d-a106-3f4ae2e7dfd2', '9d680e44-12dc-485c-9aa1-76ec4670a228'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Delete snapshot completed successfully. Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-7ae47a75-31e7-4ba5-8675-5317d34802ad tempest-ProjectReaderTests-1366321205 None] Lock "cinder-29d0ebda-854c-443a-ae7c-304ba264b921-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:16 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c673322-2766-4816-a97e-fa1429660413 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf" returned: 0 in 0.703s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:16 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf is being set with open permissions: ugo+rw Jul 11 04:22:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:16 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf Jul 11 04:22:16 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:17 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf" returned: 0 in 0.638s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:17 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info Jul 11 04:22:17 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-3399ced0-6017-4e87-ba4e-cdce57fa99c5-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-3399ced0-6017-4e87-ba4e-cdce57fa99c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "cinder-quobyte-3399ced0-6017-4e87-ba4e-cdce57fa99c5" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-3399ced0-6017-4e87-ba4e-cdce57fa99c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[5122250f-5222-4d38-8c8b-ae27711825ab]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:17 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 Jul 11 04:22:17 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:17 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:17 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info is being set with open permissions: ugo+rw Jul 11 04:22:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:17 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info Jul 11 04:22:17 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:18 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:18 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5 Jul 11 04:22:18 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:18 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.info" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.320s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:18 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-fa53dd26-17d3-468a-9ea5-b75345244fc5 tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:22:18 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-3399ced0-6017-4e87-ba4e-cdce57fa99c5" returned: 0 in 0.627s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-quobyte-3399ced0-6017-4e87-ba4e-cdce57fa99c5" released by "delete_volume" :: held 1.435s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Created reservations ['9a15c012-dd8b-445b-9309-a773b8f2d3a5', 'fd382aa3-7251-4bf0-827e-fb20e19e90ae', 'd9e6e271-2194-4c44-bb7c-49ca1004479f', '1ebcbec5-70e0-49fe-857b-c3d5808ddb78'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:19 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:19 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-7096ad37-1a88-456b-86ff-95d37234edcf-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Lock "cinder-7096ad37-1a88-456b-86ff-95d37234edcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-8c673322-2766-4816-a97e-fa1429660413" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-8c673322-2766-4816-a97e-fa1429660413" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-7096ad37-1a88-456b-86ff-95d37234edcf" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7096ad37-1a88-456b-86ff-95d37234edcf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot 7096ad37-1a88-456b-86ff-95d37234edcf of volume 8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8245d7ed-a0ed-4b2e-ac8c-428eda8e65b6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:19 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.666s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Deleted volume successfully. Jul 11 04:22:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-c26357d4-d1f2-4633-98a9-f1580a5fa9b4 tempest-ProjectReaderTests-1366321205 None] Lock "cinder-3399ced0-6017-4e87-ba4e-cdce57fa99c5-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:19 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf Jul 11 04:22:19 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:20 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf" returned: 0 in 0.775s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:20 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c673322-2766-4816-a97e-fa1429660413(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:22:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4940b3-c7dc-46bf-ba00-74867a800d7d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:20 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 Jul 11 04:22:20 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:21 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413" returned: 0 in 0.805s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:21 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf Jul 11 04:22:21 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:21 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf" returned: 0 in 0.728s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:22 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf Jul 11 04:22:22 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:22 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413.7096ad37-1a88-456b-86ff-95d37234edcf" returned: 0 in 0.641s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7096ad37-1a88-456b-86ff-95d37234edcf" released by "_delete_snapshot" :: held 3.087s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-8c673322-2766-4816-a97e-fa1429660413" released by "delete_snapshot" :: held 3.110s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Created reservations ['a62a82e1-3cff-46ff-9bfb-9744f2ac71e5', '1811f461-10a9-427e-8f30-fa528e481a82', 'e7f8d6e2-84d4-407e-88b9-09d5e7e607bf', 'cc7d9d96-ab45-43f9-a79e-140b38abf589'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:22 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:22:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f1d7644d-5b38-4a2f-a734-e6934d0fbe27 tempest-ProjectMemberTests-476116560 None] Lock "cinder-7096ad37-1a88-456b-86ff-95d37234edcf-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-8c673322-2766-4816-a97e-fa1429660413-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Lock "cinder-8c673322-2766-4816-a97e-fa1429660413-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-8c673322-2766-4816-a97e-fa1429660413" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-8c673322-2766-4816-a97e-fa1429660413" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:23 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62aaab-b96f-46a2-a8b4-c062e6d53982]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:23 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 Jul 11 04:22:23 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:24 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413" returned: 0 in 0.775s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:24 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:24 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413 Jul 11 04:22:24 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:25 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-8c673322-2766-4816-a97e-fa1429660413" returned: 0 in 0.624s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-8c673322-2766-4816-a97e-fa1429660413" released by "delete_volume" :: held 1.461s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Created reservations ['c1c3cbb8-eaba-47c1-b70c-dcc65b276a8a', 'f8b2f298-64de-4078-8013-d429ceb7ddd3', '43952a1f-6645-460a-ad35-ebacedc6c04f', 'd987ab2a-2e2e-45ae-930f-f9d3e6c5ac2f'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:25 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:25 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:25 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:26 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.656s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:26 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-62c0162b-a99d-4b81-9c67-55486b7fcdcc tempest-ProjectMemberTests-476116560 None] Lock "cinder-8c673322-2766-4816-a97e-fa1429660413-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (1eb07126-e878-479b-adbc-94747382a692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83cc3bd-1181-448e-bd61-d4db9c457eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83cc3bd-1181-448e-bd61-d4db9c457eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863262297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1a5298-67ab-43b6-9c20-aefa225775a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:27Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7d5a49-aa5f-4418-a40d-380e79a3e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d7d5a49-aa5f-4418-a40d-380e79a3e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0e80e5-d580-4735-ac3d-85239639306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0e80e5-d580-4735-ac3d-85239639306c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1a5298-67ab-43b6-9c20-aefa225775a8', 'volume_name': 'volume-7b1a5298-67ab-43b6-9c20-aefa225775a8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae53079-bc3d-4cd1-aaf4-6d0ba922fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae53079-bc3d-4cd1-aaf4-6d0ba922fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15e2f07-a46f-4d52-840c-a6d02e1678d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:26 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Volume 7b1a5298-67ab-43b6-9c20-aefa225775a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1a5298-67ab-43b6-9c20-aefa225775a8', 'volume_size': 1} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863262297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1a5298-67ab-43b6-9c20-aefa225775a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:27Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Creating volume 7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:26 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:26 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:26 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 1073741824 Jul 11 04:22:26 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:27 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 1073741824" returned: 0 in 0.826s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:27 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:27 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 Jul 11 04:22:27 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:28 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8" returned: 0 in 0.634s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15e2f07-a46f-4d52-840c-a6d02e1678d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1a5298-67ab-43b6-9c20-aefa225775a8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272f1d50-1ac4-4e0d-8ad8-a88af0af541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:28 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Volume volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 (7b1a5298-67ab-43b6-9c20-aefa225775a8): created successfully Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272f1d50-1ac4-4e0d-8ad8-a88af0af541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (1eb07126-e878-479b-adbc-94747382a692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:28 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-713d82c9-2b22-4ae2-b09a-fb518bc2ec9c tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Creating offline snapshot f5acd17c-81a9-4515-b24a-0e2611833893 of volume 7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f6d79-4cb7-4f45-8f91-6beb6db18be1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:28 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:28 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 Jul 11 04:22:28 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:29 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8" returned: 0 in 0.749s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:29 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:29 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 1G Jul 11 04:22:29 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:30 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 1G" returned: 0 in 0.807s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:30 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:30 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 Jul 11 04:22:30 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:31 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893" returned: 0 in 0.724s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:31 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 is being set with open permissions: ugo+rw Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:31 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 Jul 11 04:22:31 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Flow 'volume_create_manager' (4d4e62b2-750a-4c0e-b7e7-09c023d02278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf84794-dcf0-4849-a84a-959cb86f9e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf84794-dcf0-4849-a84a-959cb86f9e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303785336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425f7575-1460-4d9a-96a7-b3fa6fc13358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9bd23805754737a439cba7e2e79a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:31Z,use_quota=True,user_id='356f00e861a6420bb5aa68c248d2acd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23afbbfc-6127-4a2b-8298-0880188f9ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23afbbfc-6127-4a2b-8298-0880188f9ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc6c267-f63f-4dc9-b5cc-6a4099420a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc6c267-f63f-4dc9-b5cc-6a4099420a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425f7575-1460-4d9a-96a7-b3fa6fc13358', 'volume_name': 'volume-425f7575-1460-4d9a-96a7-b3fa6fc13358', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc4ba84-ee41-4802-99dd-742f5a038afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc4ba84-ee41-4802-99dd-742f5a038afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8a8755-7511-4ddb-a3af-1885a066b6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:31 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Volume 425f7575-1460-4d9a-96a7-b3fa6fc13358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425f7575-1460-4d9a-96a7-b3fa6fc13358', 'volume_size': 1} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:31 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893" returned: 0 in 0.609s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:31 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:31 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info Jul 11 04:22:31 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:32 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info" returned: 0 in 0.633s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:32 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info is being set with open permissions: ugo+rw Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:32 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info Jul 11 04:22:32 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:32 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.info" returned: 0 in 0.616s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.774s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303785336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425f7575-1460-4d9a-96a7-b3fa6fc13358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9bd23805754737a439cba7e2e79a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:31Z,use_quota=True,user_id='356f00e861a6420bb5aa68c248d2acd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Creating volume 425f7575-1460-4d9a-96a7-b3fa6fc13358 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:32 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:32 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:32 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 1073741824 Jul 11 04:22:32 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:32 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7ac82514-efa9-4872-ba94-9f77efd1774f tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:22:33 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 1073741824" returned: 0 in 0.786s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:33 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 Jul 11 04:22:33 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-f5acd17c-81a9-4515-b24a-0e2611833893-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Lock "cinder-f5acd17c-81a9-4515-b24a-0e2611833893-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-7b1a5298-67ab-43b6-9c20-aefa225775a8" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b1a5298-67ab-43b6-9c20-aefa225775a8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:33 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-f5acd17c-81a9-4515-b24a-0e2611833893" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-f5acd17c-81a9-4515-b24a-0e2611833893" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot f5acd17c-81a9-4515-b24a-0e2611833893 of volume 7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3458afb5-b4f2-4363-bd10-37674d377bfb]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:34 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 Jul 11 04:22:34 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:34 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8a8755-7511-4ddb-a3af-1885a066b6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425f7575-1460-4d9a-96a7-b3fa6fc13358', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8baec-a2d3-4ce9-a2b8-d1ab56012479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:34 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Volume volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 (425f7575-1460-4d9a-96a7-b3fa6fc13358): created successfully Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8baec-a2d3-4ce9-a2b8-d1ab56012479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Flow 'volume_create_manager' (4d4e62b2-750a-4c0e-b7e7-09c023d02278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:34 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f46f611a-1acd-4c02-ac8a-b6a2db1ff767 tempest-ProjectReaderTests-969518745 None] Created volume successfully. Jul 11 04:22:34 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b1a5298-67ab-43b6-9c20-aefa225775a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9449f6-6dd2-416e-be12-d23227ddc4ad]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:34 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:34 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 Jul 11 04:22:34 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Acquiring lock "cinder-425f7575-1460-4d9a-96a7-b3fa6fc13358-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Lock "cinder-425f7575-1460-4d9a-96a7-b3fa6fc13358-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Acquiring lock "cinder-quobyte-425f7575-1460-4d9a-96a7-b3fa6fc13358" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Lock "cinder-quobyte-425f7575-1460-4d9a-96a7-b3fa6fc13358" acquired by "delete_volume" :: waited 0.033s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b92116-4a4b-4927-bc02-aeaf6d70fc83]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:35 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:35 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:35 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 Jul 11 04:22:35 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:35 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 Jul 11 04:22:35 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:36 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:36 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893" returned: 0 in 0.751s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:36 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:36 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358 Jul 11 04:22:36 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:36 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893 Jul 11 04:22:36 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:37 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8.f5acd17c-81a9-4515-b24a-0e2611833893" returned: 0 in 0.679s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:37 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-425f7575-1460-4d9a-96a7-b3fa6fc13358" returned: 0 in 0.712s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-f5acd17c-81a9-4515-b24a-0e2611833893" released by "_delete_snapshot" :: held 3.024s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b1a5298-67ab-43b6-9c20-aefa225775a8" released by "delete_snapshot" :: held 3.053s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Lock "cinder-quobyte-425f7575-1460-4d9a-96a7-b3fa6fc13358" released by "delete_volume" :: held 1.533s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Created reservations ['0263c93d-57bb-424a-b754-8dcdd756d45e', '24f8c160-0099-4966-926f-88261a006098', '9aa7baea-1319-47e7-a1e9-408b8d9c8b35', '3f1c9861-d0e6-4029-93e7-77d0a000b5e5'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Created reservations ['dbf35968-11b1-405c-8ba8-5aa72b32e1c8', '942bdc84-277b-4b27-8528-5ad3fed084f7', 'c721edd5-44e1-4fb8-8f29-115140e72652', '5a8d110a-b22d-408f-a16f-5220159931be'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:37 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-481d69e2-87d9-41a2-8a79-dd89210584f5 tempest-ProjectMemberTests-476116560 None] Lock "cinder-f5acd17c-81a9-4515-b24a-0e2611833893-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:37 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:37 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:37 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.663s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:37 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Deleted volume successfully. Jul 11 04:22:37 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b3521649-5c6d-4a37-af1b-aa0b00e32066 tempest-ProjectReaderTests-969518745 None] Lock "cinder-425f7575-1460-4d9a-96a7-b3fa6fc13358-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Flow 'volume_create_manager' (acc582d5-26ad-4274-bb3d-e5aea95045a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51842767-b5fd-41da-916a-116f556987b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-7b1a5298-67ab-43b6-9c20-aefa225775a8-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51842767-b5fd-41da-916a-116f556987b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921178125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38440906-0a8d-4a79-b50b-7972917f2776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9bd23805754737a439cba7e2e79a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:38Z,use_quota=True,user_id='356f00e861a6420bb5aa68c248d2acd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0021bb-0d4b-44ca-bd2d-543ae10a8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0021bb-0d4b-44ca-bd2d-543ae10a8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17037a1d-f3a9-4dd9-862c-001ba41dc1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17037a1d-f3a9-4dd9-862c-001ba41dc1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38440906-0a8d-4a79-b50b-7972917f2776', 'volume_name': 'volume-38440906-0a8d-4a79-b50b-7972917f2776', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4380f887-637b-43f0-9f1a-ccfc4da0b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4380f887-637b-43f0-9f1a-ccfc4da0b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5506f266-bf74-45c5-a485-187fa1fbbce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:38 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Volume 38440906-0a8d-4a79-b50b-7972917f2776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38440906-0a8d-4a79-b50b-7972917f2776', 'volume_size': 1} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1921178125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38440906-0a8d-4a79-b50b-7972917f2776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9bd23805754737a439cba7e2e79a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:38Z,use_quota=True,user_id='356f00e861a6420bb5aa68c248d2acd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Creating volume 38440906-0a8d-4a79-b50b-7972917f2776 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:38 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:38 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 1073741824 Jul 11 04:22:38 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Lock "cinder-7b1a5298-67ab-43b6-9c20-aefa225775a8-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-7b1a5298-67ab-43b6-9c20-aefa225775a8" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b1a5298-67ab-43b6-9c20-aefa225775a8" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ae927-48a3-4a2c-ae98-e6d4690f3801]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:38 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:38 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 Jul 11 04:22:38 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:39 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 1073741824" returned: 0 in 0.844s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:39 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 Jul 11 04:22:39 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:39 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8" returned: 0 in 0.789s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:39 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8 Jul 11 04:22:39 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:39 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776" returned: 0 in 0.650s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5506f266-bf74-45c5-a485-187fa1fbbce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38440906-0a8d-4a79-b50b-7972917f2776', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f4a2f-7738-44df-883a-48be2c939094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:39 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Volume volume-38440906-0a8d-4a79-b50b-7972917f2776 (38440906-0a8d-4a79-b50b-7972917f2776): created successfully Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737f4a2f-7738-44df-883a-48be2c939094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Flow 'volume_create_manager' (acc582d5-26ad-4274-bb3d-e5aea95045a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:39 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-6f3b3d75-540d-4d93-801d-3e8709b4c8cc tempest-ProjectReaderTests-969518745 None] Created volume successfully. Jul 11 04:22:39 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-7b1a5298-67ab-43b6-9c20-aefa225775a8" returned: 0 in 0.673s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-7b1a5298-67ab-43b6-9c20-aefa225775a8" released by "delete_volume" :: held 1.528s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Created reservations ['04a07f41-4272-4ddc-bb58-bf7bd26f176f', '367a2e75-2dec-471a-9c1a-aa6a7e18d262', '639c9f5a-3ec4-4268-b329-bb048c01d232', '529701da-7919-4945-87cf-bb4f9b291063'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:39 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:40 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:40 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Acquiring lock "cinder-38440906-0a8d-4a79-b50b-7972917f2776-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Lock "cinder-38440906-0a8d-4a79-b50b-7972917f2776-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Acquiring lock "cinder-quobyte-38440906-0a8d-4a79-b50b-7972917f2776" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Lock "cinder-quobyte-38440906-0a8d-4a79-b50b-7972917f2776" acquired by "delete_volume" :: waited 0.027s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ceee2-4868-4f71-a034-2997169beed2]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:40 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 Jul 11 04:22:40 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:40 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.732s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:40 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f6486f96-c884-4f25-8bd4-c32233acc0b1 tempest-ProjectMemberTests-476116560 None] Lock "cinder-7b1a5298-67ab-43b6-9c20-aefa225775a8-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (e8f069bd-69b7-405b-bd88-7a18969ab9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e38a73-1973-4e91-8541-577893678411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e38a73-1973-4e91-8541-577893678411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846038456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455a0580-d2b3-41da-8897-420aa6b75f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:41Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15340cc9-1502-477f-ad56-bc9ffc9aaec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15340cc9-1502-477f-ad56-bc9ffc9aaec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077da4f5-61dd-4146-a9cc-f74797248585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077da4f5-61dd-4146-a9cc-f74797248585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '455a0580-d2b3-41da-8897-420aa6b75f6c', 'volume_name': 'volume-455a0580-d2b3-41da-8897-420aa6b75f6c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07612e-f41e-468d-a559-905a58c235a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa07612e-f41e-468d-a559-905a58c235a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:40 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7d6926-94ea-4bda-b11f-077670d8d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:40 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Volume 455a0580-d2b3-41da-8897-420aa6b75f6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-455a0580-d2b3-41da-8897-420aa6b75f6c', 'volume_size': 1} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846038456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455a0580-d2b3-41da-8897-420aa6b75f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:41Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Creating volume 455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:41 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:41 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c 1073741824 Jul 11 04:22:41 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:41 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776" returned: 0 in 0.829s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:41 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776 Jul 11 04:22:41 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:41 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-38440906-0a8d-4a79-b50b-7972917f2776" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:41 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c 1073741824" returned: 0 in 0.877s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Lock "cinder-quobyte-38440906-0a8d-4a79-b50b-7972917f2776" released by "delete_volume" :: held 1.604s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:41 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c Jul 11 04:22:41 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:41 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Created reservations ['dd5dff91-8ad2-4d20-a0dd-593b81e2d175', 'ee73f70b-e575-44b0-a32b-4b8fbe7fa2f2', '21394d4f-2caa-4a45-a0ff-05c84084ae6b', 'e715addb-75c0-455f-8bf1-9531efc759f9'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:42 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:42 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:42 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c" returned: 0 in 0.645s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7d6926-94ea-4bda-b11f-077670d8d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455a0580-d2b3-41da-8897-420aa6b75f6c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe0fbf9-7c23-40fd-a914-2af0aeba35e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:42 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Volume volume-455a0580-d2b3-41da-8897-420aa6b75f6c (455a0580-d2b3-41da-8897-420aa6b75f6c): created successfully Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe0fbf9-7c23-40fd-a914-2af0aeba35e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (e8f069bd-69b7-405b-bd88-7a18969ab9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:42 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-2e6273cf-b32b-4472-a7fd-c796ffc6d472 tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:22:42 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.696s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:42 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Deleted volume successfully. Jul 11 04:22:42 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-91828723-653e-474b-8069-76ff3f97d5fa tempest-ProjectReaderTests-969518745 None] Lock "cinder-38440906-0a8d-4a79-b50b-7972917f2776-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:43 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Creating offline snapshot c9743911-a6d7-46d3-a598-02936563dc87 of volume 455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:22:43 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d79fc4a-740e-4caa-9352-609e658afc68]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:43 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:43 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c Jul 11 04:22:43 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:44 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c" returned: 0 in 0.826s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:44 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 1G Jul 11 04:22:44 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:44 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 1G" returned: 0 in 0.888s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:44 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455a0580-d2b3-41da-8897-420aa6b75f6c -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:44 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455a0580-d2b3-41da-8897-420aa6b75f6c -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 Jul 11 04:22:44 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:45 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455a0580-d2b3-41da-8897-420aa6b75f6c -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87" returned: 0 in 0.734s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:45 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 is being set with open permissions: ugo+rw Jul 11 04:22:45 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:45 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 Jul 11 04:22:45 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (85b3ae8a-e5b6-419a-97bb-ca7c9082bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354230f9-6d3a-4870-b668-ec98a729a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354230f9-6d3a-4870-b668-ec98a729a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638133839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0927ad-1d31-4652-82e4-658dc8d745ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:46Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd37d8ed-a326-415d-8124-4112943d7328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd37d8ed-a326-415d-8124-4112943d7328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef293d2-49aa-44a4-adc2-a167dcbe0717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef293d2-49aa-44a4-adc2-a167dcbe0717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0927ad-1d31-4652-82e4-658dc8d745ef', 'volume_name': 'volume-9d0927ad-1d31-4652-82e4-658dc8d745ef', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:46 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56dfc64-f292-45d4-a441-04d10c32284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56dfc64-f292-45d4-a441-04d10c32284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de9989b-fb59-4e38-87c6-659b3181ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:46 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Volume 9d0927ad-1d31-4652-82e4-658dc8d745ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0927ad-1d31-4652-82e4-658dc8d745ef', 'volume_size': 1} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87" returned: 0 in 0.788s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:46 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:46 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info Jul 11 04:22:46 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:47 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:47 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info is being set with open permissions: ugo+rw Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:47 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info Jul 11 04:22:47 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:47 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.info" returned: 0 in 0.678s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638133839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0927ad-1d31-4652-82e4-658dc8d745ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:46Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Creating volume 9d0927ad-1d31-4652-82e4-658dc8d745ef {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:47 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:47 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:47 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef 1073741824 Jul 11 04:22:47 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:47 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-82a54052-5fe2-4b11-a00d-b400de4effed tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-c9743911-a6d7-46d3-a598-02936563dc87-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Lock "cinder-c9743911-a6d7-46d3-a598-02936563dc87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-455a0580-d2b3-41da-8897-420aa6b75f6c" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-455a0580-d2b3-41da-8897-420aa6b75f6c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-c9743911-a6d7-46d3-a598-02936563dc87" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-c9743911-a6d7-46d3-a598-02936563dc87" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot c9743911-a6d7-46d3-a598-02936563dc87 of volume 455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac094dc-ce63-4748-a964-461cbd45c92c]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:48 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 Jul 11 04:22:48 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:48 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef 1073741824" returned: 0 in 0.867s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:48 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:48 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef Jul 11 04:22:48 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:49 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef" returned: 0 in 0.615s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de9989b-fb59-4e38-87c6-659b3181ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0927ad-1d31-4652-82e4-658dc8d745ef', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:49 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bb454c-4254-41a1-8f8f-50026c307847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87" returned: 0 in 0.807s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-455a0580-d2b3-41da-8897-420aa6b75f6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee5708-42a7-4f11-8b87-88bb0cbb27f1]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:49 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Volume volume-9d0927ad-1d31-4652-82e4-658dc8d745ef (9d0927ad-1d31-4652-82e4-658dc8d745ef): created successfully Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bb454c-4254-41a1-8f8f-50026c307847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:49 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (85b3ae8a-e5b6-419a-97bb-ca7c9082bd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:49 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f1d2ed2e-9744-4628-a144-dd3ba683fb10 tempest-ProjectReaderTests-35043547 None] Created volume successfully. Jul 11 04:22:49 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c Jul 11 04:22:49 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:50 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:50 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 Jul 11 04:22:50 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-9d0927ad-1d31-4652-82e4-658dc8d745ef-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Lock "cinder-9d0927ad-1d31-4652-82e4-658dc8d745ef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-quobyte-9d0927ad-1d31-4652-82e4-658dc8d745ef" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-9d0927ad-1d31-4652-82e4-658dc8d745ef" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:50 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87" returned: 0 in 0.744s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0451295-cf6f-4358-a643-620579118bc6]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:50 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:50 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87 Jul 11 04:22:50 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:50 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef Jul 11 04:22:50 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:51 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c.c9743911-a6d7-46d3-a598-02936563dc87" returned: 0 in 0.667s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-c9743911-a6d7-46d3-a598-02936563dc87" released by "_delete_snapshot" :: held 3.032s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-455a0580-d2b3-41da-8897-420aa6b75f6c" released by "delete_snapshot" :: held 3.059s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:51 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef" returned: 0 in 0.741s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:51 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef Jul 11 04:22:51 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Created reservations ['85758308-b0df-44a8-af08-c082100dbf15', '5883c840-eb70-4363-823d-2793e10c075e', 'b92479ce-44af-439c-a528-72e2160c6418', '85c5537e-dbdd-4628-923e-8647555d4eb2'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:51 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:22:51 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-88ff4eb9-496d-440d-8859-4e1c79f2fbd4 tempest-ProjectMemberTests-476116560 None] Lock "cinder-c9743911-a6d7-46d3-a598-02936563dc87-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:52 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-9d0927ad-1d31-4652-82e4-658dc8d745ef" returned: 0 in 0.602s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-9d0927ad-1d31-4652-82e4-658dc8d745ef" released by "delete_volume" :: held 1.382s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Created reservations ['45a5d281-8915-4a9e-9f53-b1e929f78703', '58d6cf6c-24a9-4a4e-a81a-5452f2e447d7', 'dcca2118-6bc1-46af-b316-a7eae3aa8ae1', 'd5f25638-7e57-4a76-819a-13a8ac353f21'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:52 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:52 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-455a0580-d2b3-41da-8897-420aa6b75f6c-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Lock "cinder-455a0580-d2b3-41da-8897-420aa6b75f6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-455a0580-d2b3-41da-8897-420aa6b75f6c" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-455a0580-d2b3-41da-8897-420aa6b75f6c" acquired by "delete_volume" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc97bbb-c79b-4652-b9cc-e01ee82afefa]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:52 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:52 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c Jul 11 04:22:52 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:52 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.682s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:53 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Deleted volume successfully. Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-756d9f22-fa3e-425d-8091-3bb49cf49ce6 tempest-ProjectReaderTests-35043547 None] Lock "cinder-9d0927ad-1d31-4652-82e4-658dc8d745ef-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (0257ba33-b79a-41e7-9201-b9209457bf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5ff960-3c65-4863-84d3-4f27107e5d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5ff960-3c65-4863-84d3-4f27107e5d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979348696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60b16b9-41cd-499c-a41c-d0081b559c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:53Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b764ef75-de02-49c7-bcb4-cccce17c5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b764ef75-de02-49c7-bcb4-cccce17c5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04403254-b2a1-4487-972e-c15284448970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04403254-b2a1-4487-972e-c15284448970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60b16b9-41cd-499c-a41c-d0081b559c31', 'volume_name': 'volume-d60b16b9-41cd-499c-a41c-d0081b559c31', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b428de-3808-41e3-9692-5df50cb5d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b428de-3808-41e3-9692-5df50cb5d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c814734-1b81-449e-8ed7-ee9034240564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:53 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Volume d60b16b9-41cd-499c-a41c-d0081b559c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60b16b9-41cd-499c-a41c-d0081b559c31', 'volume_size': 1} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979348696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60b16b9-41cd-499c-a41c-d0081b559c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:53Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Creating volume d60b16b9-41cd-499c-a41c-d0081b559c31 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:53 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:53 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 1073741824 Jul 11 04:22:53 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:53 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c" returned: 0 in 0.973s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:53 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:53 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c Jul 11 04:22:53 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:54 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 1073741824" returned: 0 in 0.793s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=106,cinder:INSERT=41,cinder:UPDATE=139,cinder:DELETE=11 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:54 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 Jul 11 04:22:54 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:54 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-455a0580-d2b3-41da-8897-420aa6b75f6c" returned: 0 in 0.666s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-455a0580-d2b3-41da-8897-420aa6b75f6c" released by "delete_volume" :: held 1.712s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Created reservations ['ec35ab40-d07c-4b82-b6fd-f072195c5b69', 'ba92fd4c-7525-4eb6-afe5-c111e92c7eff', '316a1f2f-830c-429f-83f5-ec2a8a37a0de', '38a9b7a4-0e3e-4de4-a5f0-94ac86bd8d3a'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:54 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:54 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:54 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:55 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31" returned: 0 in 0.671s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c814734-1b81-449e-8ed7-ee9034240564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60b16b9-41cd-499c-a41c-d0081b559c31', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ddf3ae-2068-4673-bb1c-aa2ef3878dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Volume volume-d60b16b9-41cd-499c-a41c-d0081b559c31 (d60b16b9-41cd-499c-a41c-d0081b559c31): created successfully Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ddf3ae-2068-4673-bb1c-aa2ef3878dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (0257ba33-b79a-41e7-9201-b9209457bf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a016a832-ed12-42be-9f77-75d3e1634484 tempest-ProjectReaderTests-35043547 None] Created volume successfully. Jul 11 04:22:55 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.656s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:55 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-9488e134-10c7-43ad-bf58-0c7869fd539f tempest-ProjectMemberTests-476116560 None] Lock "cinder-455a0580-d2b3-41da-8897-420aa6b75f6c-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (bc0eab88-76c9-4e00-bce1-a50e53521405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3d7aa0-41ae-458e-8c83-79fbde3607fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3d7aa0-41ae-458e-8c83-79fbde3607fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708834061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284ad398-baab-4d14-9149-a283df48832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:55Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217fd072-62c3-4439-8ee8-b3dcfaf43e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217fd072-62c3-4439-8ee8-b3dcfaf43e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21ea6d5-80ca-4cfa-ba45-fff721ee4bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21ea6d5-80ca-4cfa-ba45-fff721ee4bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284ad398-baab-4d14-9149-a283df48832a', 'volume_name': 'volume-284ad398-baab-4d14-9149-a283df48832a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31badb03-650c-4ce3-a3f9-206d44b154de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31badb03-650c-4ce3-a3f9-206d44b154de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1440c35-045c-40bf-b60d-a234f1c32ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:55 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Volume 284ad398-baab-4d14-9149-a283df48832a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284ad398-baab-4d14-9149-a283df48832a', 'volume_size': 1} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708834061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284ad398-baab-4d14-9149-a283df48832a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:55Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Creating volume 284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:22:55 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:55 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a 1073741824 Jul 11 04:22:55 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-d60b16b9-41cd-499c-a41c-d0081b559c31-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Lock "cinder-d60b16b9-41cd-499c-a41c-d0081b559c31-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-quobyte-d60b16b9-41cd-499c-a41c-d0081b559c31" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-d60b16b9-41cd-499c-a41c-d0081b559c31" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[847bde54-8405-46a1-84ca-fdf4ba33603d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:55 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:55 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 Jul 11 04:22:55 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:56 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a 1073741824" returned: 0 in 0.810s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:56 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a Jul 11 04:22:56 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:56 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31" returned: 0 in 0.773s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:56 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31 Jul 11 04:22:56 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:56 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a" returned: 0 in 0.626s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:22:56 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1440c35-045c-40bf-b60d-a234f1c32ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284ad398-baab-4d14-9149-a283df48832a', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78835da5-b42c-4b12-84bf-c2571cad1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:UPDATE=156,cinder:SELECT=115,cinder:DELETE=13,cinder:INSERT=38 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:22:57 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Volume volume-284ad398-baab-4d14-9149-a283df48832a (284ad398-baab-4d14-9149-a283df48832a): created successfully Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78835da5-b42c-4b12-84bf-c2571cad1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (bc0eab88-76c9-4e00-bce1-a50e53521405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-c6eb9f8e-e792-4863-930e-8fa8cacc40e8 tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:22:57 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-d60b16b9-41cd-499c-a41c-d0081b559c31" returned: 0 in 0.646s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-d60b16b9-41cd-499c-a41c-d0081b559c31" released by "delete_volume" :: held 1.458s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Created reservations ['b1bfbc7e-0ade-461c-8210-846bb8cf8658', 'a0037222-7310-48f9-a736-5e1c64dc2c40', '12e1dfab-0389-46c8-a1b0-db60c05c6ac8', '3bbb4c23-1534-411e-9293-704dfba583f8'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:57 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:22:57 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Creating offline snapshot 53dc5e10-65c2-4073-9038-48eb26061090 of volume 284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a7a01-2ad5-435c-a8ef-fb846c7e48e4]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:57 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a Jul 11 04:22:57 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:57 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:22:57 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Deleted volume successfully. Jul 11 04:22:57 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-dfcc4c9a-f708-4d11-90fa-d9161f385186 tempest-ProjectReaderTests-35043547 None] Lock "cinder-d60b16b9-41cd-499c-a41c-d0081b559c31-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (1a427a87-8ed6-4dae-83fe-be56cb0deffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729ade44-79ef-42ed-a771-56b66704e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729ade44-79ef-42ed-a771-56b66704e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841592472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c90eb8-9560-4cce-be86-4afa03b49fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:58Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52691fb8-3b8e-4de6-8a07-b051c3efb3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52691fb8-3b8e-4de6-8a07-b051c3efb3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c331ec26-9617-479c-b803-3d5b6a85ab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c331ec26-9617-479c-b803-3d5b6a85ab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c90eb8-9560-4cce-be86-4afa03b49fb8', 'volume_name': 'volume-29c90eb8-9560-4cce-be86-4afa03b49fb8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecee1e12-536e-4e55-9ebb-92ff8f8581e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecee1e12-536e-4e55-9ebb-92ff8f8581e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3154fa4b-81b8-4cf7-97e6-0c7c135cb35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:22:58 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Volume 29c90eb8-9560-4cce-be86-4afa03b49fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c90eb8-9560-4cce-be86-4afa03b49fb8', 'volume_size': 1} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:22:58 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a" returned: 0 in 0.777s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:58 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:58 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 1G Jul 11 04:22:58 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:59 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 1G" returned: 0 in 0.741s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-284ad398-baab-4d14-9149-a283df48832a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:59 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-284ad398-baab-4d14-9149-a283df48832a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 Jul 11 04:22:59 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:22:59 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 11 04:22:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-284ad398-baab-4d14-9149-a283df48832a -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090" returned: 0 in 0.655s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:22:59 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 is being set with open permissions: ugo+rw Jul 11 04:22:59 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:22:59 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 Jul 11 04:22:59 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:00 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090" returned: 0 in 0.615s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:00 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info Jul 11 04:23:00 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:01 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info" returned: 0 in 0.671s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:01 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info is being set with open permissions: ugo+rw Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:01 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info Jul 11 04:23:01 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:01 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.info" returned: 0 in 0.653s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.198s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.457s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841592472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c90eb8-9560-4cce-be86-4afa03b49fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:22:58Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Creating volume 29c90eb8-9560-4cce-be86-4afa03b49fb8 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:23:01 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:23:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:01 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 1073741824 Jul 11 04:23:01 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:01 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-7cdd9e24-b1c4-425f-a8f1-8aab4eabdae2 tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:23:02 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 1073741824" returned: 0 in 0.842s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:02 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 Jul 11 04:23:02 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-53dc5e10-65c2-4073-9038-48eb26061090-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Lock "cinder-53dc5e10-65c2-4073-9038-48eb26061090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-284ad398-baab-4d14-9149-a283df48832a" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-284ad398-baab-4d14-9149-a283df48832a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-53dc5e10-65c2-4073-9038-48eb26061090" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-53dc5e10-65c2-4073-9038-48eb26061090" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot 53dc5e10-65c2-4073-9038-48eb26061090 of volume 284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a393d1df-4114-4bef-b542-0e2110baef98]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:03 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 Jul 11 04:23:03 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:03 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8" returned: 0 in 0.719s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3154fa4b-81b8-4cf7-97e6-0c7c135cb35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c90eb8-9560-4cce-be86-4afa03b49fb8', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08204c95-7396-4975-a3b6-813e54945f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:03 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Volume volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 (29c90eb8-9560-4cce-be86-4afa03b49fb8): created successfully Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08204c95-7396-4975-a3b6-813e54945f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (1a427a87-8ed6-4dae-83fe-be56cb0deffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:23:03 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-38b6fea8-88dc-4ed7-a83d-994cad4285d6 tempest-ProjectReaderTests-35043547 None] Created volume successfully. Jul 11 04:23:03 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090" returned: 0 in 0.796s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-284ad398-baab-4d14-9149-a283df48832a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e034b-dc11-4541-812c-73f5a0e2448d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:03 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a Jul 11 04:23:03 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:04 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a" returned: 0 in 0.744s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:04 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 Jul 11 04:23:04 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-29c90eb8-9560-4cce-be86-4afa03b49fb8-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Lock "cinder-29c90eb8-9560-4cce-be86-4afa03b49fb8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-quobyte-29c90eb8-9560-4cce-be86-4afa03b49fb8" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-29c90eb8-9560-4cce-be86-4afa03b49fb8" acquired by "delete_volume" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69139e-cac4-4c0a-abe4-a48157a7657d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:04 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 Jul 11 04:23:04 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:05 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090" returned: 0 in 0.763s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:05 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090 Jul 11 04:23:05 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:05 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8" returned: 0 in 0.835s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:05 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8 Jul 11 04:23:05 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:05 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a.53dc5e10-65c2-4073-9038-48eb26061090" returned: 0 in 0.670s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-53dc5e10-65c2-4073-9038-48eb26061090" released by "_delete_snapshot" :: held 3.083s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-284ad398-baab-4d14-9149-a283df48832a" released by "delete_snapshot" :: held 3.109s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Created reservations ['ea815734-c39a-45f2-a21b-23325d1a423c', '06e173eb-36ab-431a-81cb-ce6ee5f0bc95', '1b045a98-99df-492d-8cee-0ee13b68ab51', '3bea7d95-c7a4-4154-9140-ebafb98a01db'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:23:06 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f67c18ef-16ae-4430-8c03-76ca07686578 tempest-ProjectMemberTests-476116560 None] Lock "cinder-53dc5e10-65c2-4073-9038-48eb26061090-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:06 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-29c90eb8-9560-4cce-be86-4afa03b49fb8" returned: 0 in 0.695s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-29c90eb8-9560-4cce-be86-4afa03b49fb8" released by "delete_volume" :: held 1.571s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Created reservations ['35c48efd-46cc-4de0-9561-faa2c628cd12', '6fda6972-5bc6-4c10-ab80-f2c84ccd7c53', '8a0902a5-8175-46e1-af93-7940b6d84bc5', 'ded68d16-81df-4f3c-ad56-93b2fd63f24d'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:06 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:23:06 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:07 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.644s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:23:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Deleted volume successfully. Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-284ad398-baab-4d14-9149-a283df48832a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-21693874-f4af-4ac7-b5ba-21dc24cf4939 tempest-ProjectReaderTests-35043547 None] Lock "cinder-29c90eb8-9560-4cce-be86-4afa03b49fb8-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-284ad398-baab-4d14-9149-a283df48832a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-284ad398-baab-4d14-9149-a283df48832a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-284ad398-baab-4d14-9149-a283df48832a" acquired by "delete_volume" :: waited 0.020s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[659c9442-d447-4ffd-a917-8c7885c7d340]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:07 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a Jul 11 04:23:07 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (6af01190-a931-4bf4-92e8-2fc39e083594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea3cf96-168d-4a34-85c6-26f53df0e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea3cf96-168d-4a34-85c6-26f53df0e968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-676718760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0907b7a6-51ee-4d40-8996-ab9aca6efa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:23:07Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a0f5b3-1a73-4df2-9348-217256128b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a0f5b3-1a73-4df2-9348-217256128b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d38e5f7-53a2-444d-92d3-6f6b2f5dcb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d38e5f7-53a2-444d-92d3-6f6b2f5dcb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0907b7a6-51ee-4d40-8996-ab9aca6efa3c', 'volume_name': 'volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003b8ab0-c80a-42e3-a4f8-2f34c705de81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003b8ab0-c80a-42e3-a4f8-2f34c705de81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b413c7f-66e0-48b5-bee0-3b68312f9f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:07 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Volume 0907b7a6-51ee-4d40-8996-ab9aca6efa3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c', 'volume_size': 1} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-676718760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0907b7a6-51ee-4d40-8996-ab9aca6efa3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd05335be7f467383c4e9a9b92b5a6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:23:07Z,use_quota=True,user_id='7117d53d95804df5be71ca2ffb2bda02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Creating volume 0907b7a6-51ee-4d40-8996-ab9aca6efa3c {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:23:07 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:23:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:07 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c 1073741824 Jul 11 04:23:07 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:08 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a" returned: 0 in 0.761s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:08 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a Jul 11 04:23:08 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:08 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c 1073741824" returned: 0 in 0.823s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:08 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c Jul 11 04:23:08 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:08 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-284ad398-baab-4d14-9149-a283df48832a" returned: 0 in 0.722s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-284ad398-baab-4d14-9149-a283df48832a" released by "delete_volume" :: held 1.567s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Created reservations ['be79769e-57e4-4ddd-ac24-c6d29ab8bc6e', '261bd5a4-74cb-42c9-9005-fc17fae53213', '883424ae-d874-42b3-b38c-c5064d0fc712', '9d0d3eeb-4117-4184-91fd-6a1d7eb37895'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:08 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:23:08 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:09 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c" returned: 0 in 0.649s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b413c7f-66e0-48b5-bee0-3b68312f9f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cb27b6-66d6-499b-b473-4394eb15faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:09 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Volume volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c (0907b7a6-51ee-4d40-8996-ab9aca6efa3c): created successfully Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cb27b6-66d6-499b-b473-4394eb15faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Flow 'volume_create_manager' (6af01190-a931-4bf4-92e8-2fc39e083594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:23:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-18d6369f-7bbf-4c25-92ae-2a587f3df50d tempest-ProjectReaderTests-35043547 None] Created volume successfully. Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-0907b7a6-51ee-4d40-8996-ab9aca6efa3c-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Lock "cinder-0907b7a6-51ee-4d40-8996-ab9aca6efa3c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Acquiring lock "cinder-quobyte-0907b7a6-51ee-4d40-8996-ab9aca6efa3c" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:09 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-0907b7a6-51ee-4d40-8996-ab9aca6efa3c" acquired by "delete_volume" :: waited 0.028s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.804s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:23:09 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[f787bff5-7c34-43ab-a90b-32c3edd1f7b8]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-94cb0170-34ed-4ca1-a5c5-fbf4415ff5a6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-284ad398-baab-4d14-9149-a283df48832a-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:09 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c Jul 11 04:23:09 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (9284405c-4bd3-414e-b799-5aebe7cc7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f991a1-9b75-47d9-b2db-1d191d398b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f991a1-9b75-47d9-b2db-1d191d398b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494717649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86684c38-da33-4e25-b3b2-18f926860447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:23:10Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecd11d3-dad4-4a36-9f36-9935af2b07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecd11d3-dad4-4a36-9f36-9935af2b07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a530b765-f130-4e6b-bf59-affd9381793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a530b765-f130-4e6b-bf59-affd9381793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86684c38-da33-4e25-b3b2-18f926860447', 'volume_name': 'volume-86684c38-da33-4e25-b3b2-18f926860447', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f070869-4082-4ea8-b20b-20640b84ef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:09 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f070869-4082-4ea8-b20b-20640b84ef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f059f9-981c-4cae-b76f-c6dc8f89390e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:10 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Volume 86684c38-da33-4e25-b3b2-18f926860447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86684c38-da33-4e25-b3b2-18f926860447', 'volume_size': 1} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494717649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86684c38-da33-4e25-b3b2-18f926860447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca0e5ecfbf844be68413494edfd25e77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:23:10Z,use_quota=True,user_id='ebe5055e97fa48a09531e692cbeeec66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Creating volume 86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:23:10 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:10 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 1073741824 Jul 11 04:23:10 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:10 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c" returned: 0 in 0.848s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:10 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c Jul 11 04:23:10 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:10 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 1073741824" returned: 0 in 0.928s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:11 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 Jul 11 04:23:11 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:11 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-0907b7a6-51ee-4d40-8996-ab9aca6efa3c" returned: 0 in 0.713s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Lock "cinder-quobyte-0907b7a6-51ee-4d40-8996-ab9aca6efa3c" released by "delete_volume" :: held 1.619s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Created reservations ['bb723873-7bde-4a97-95e4-2c5f2f4501ad', '987ebff8-5d94-4109-8e65-13e474726257', '9297e1e5-3e5e-4a1d-b2fd-268768a48412', '26e911a6-8562-418a-9f81-6ffa1a1aa3f2'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:11 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:23:11 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:11 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447" returned: 0 in 0.686s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f059f9-981c-4cae-b76f-c6dc8f89390e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86684c38-da33-4e25-b3b2-18f926860447', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538c99cd-479e-4c58-9374-8e687315dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:23:11 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Volume volume-86684c38-da33-4e25-b3b2-18f926860447 (86684c38-da33-4e25-b3b2-18f926860447): created successfully Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538c99cd-479e-4c58-9374-8e687315dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:23:11 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Flow 'volume_create_manager' (9284405c-4bd3-414e-b799-5aebe7cc7f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:23:11 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-672b77ca-9072-4038-bf4c-fd06ee457d4e tempest-ProjectMemberTests-476116560 None] Created volume successfully. Jul 11 04:23:12 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.661s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:23:12 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Deleted volume successfully. Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-ae0b81f7-c83e-482c-8757-11233e038a3b tempest-ProjectReaderTests-35043547 None] Lock "cinder-0907b7a6-51ee-4d40-8996-ab9aca6efa3c-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Creating offline snapshot 244e83c4-6302-4c3c-bc17-d472c9ca26e8 of volume 86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc65fbca-f5fc-4609-bca2-4f6e08540377]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:12 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:12 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 Jul 11 04:23:12 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:13 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447" returned: 0 in 0.796s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:13 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 1G Jul 11 04:23:13 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:13 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 1G" returned: 0 in 0.840s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:13 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86684c38-da33-4e25-b3b2-18f926860447 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:13 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86684c38-da33-4e25-b3b2-18f926860447 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 Jul 11 04:23:13 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:14 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:23:14 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:14 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86684c38-da33-4e25-b3b2-18f926860447 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8" returned: 0 in 0.720s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:14 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 is being set with open permissions: ugo+rw Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:14 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 Jul 11 04:23:14 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:14 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.640s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:23:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:23:15 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8" returned: 0 in 0.638s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:15 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info Jul 11 04:23:15 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:15 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info" returned: 0 in 0.613s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:15 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info is being set with open permissions: ugo+rw Jul 11 04:23:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:15 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info Jul 11 04:23:15 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:16 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.info" returned: 0 in 0.607s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.297s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:16 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-a55d774b-46c3-4779-9119-fb7ba2180b09 tempest-ProjectMemberTests-476116560 None] Create snapshot completed successfully Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-244e83c4-6302-4c3c-bc17-d472c9ca26e8-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Lock "cinder-244e83c4-6302-4c3c-bc17-d472c9ca26e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-86684c38-da33-4e25-b3b2-18f926860447" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-86684c38-da33-4e25-b3b2-18f926860447" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-244e83c4-6302-4c3c-bc17-d472c9ca26e8" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-244e83c4-6302-4c3c-bc17-d472c9ca26e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Deleting offline snapshot 244e83c4-6302-4c3c-bc17-d472c9ca26e8 of volume 86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] snapshot_file for this snap is: volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d350ac-b6d5-41ff-b08a-8204c3620621]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:17 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 Jul 11 04:23:17 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:18 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8" returned: 0 in 0.750s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:18 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86684c38-da33-4e25-b3b2-18f926860447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:23:18 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba0215-3c73-4639-97e4-8c364c704209]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:18 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 Jul 11 04:23:18 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:19 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447" returned: 0 in 0.733s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:19 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 Jul 11 04:23:19 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:19 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8" returned: 0 in 0.733s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:19 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8 Jul 11 04:23:19 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:20 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447.244e83c4-6302-4c3c-bc17-d472c9ca26e8" returned: 0 in 0.612s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-244e83c4-6302-4c3c-bc17-d472c9ca26e8" released by "_delete_snapshot" :: held 2.918s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-86684c38-da33-4e25-b3b2-18f926860447" released by "delete_snapshot" :: held 2.940s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Created reservations ['cd4bbecf-d97e-45ca-bbb2-5b46a7a25ae8', 'c12e23f1-9eff-4512-b6b6-336bd4971940', '039d7ae5-a9fa-4b64-90e6-031c1bdd4c39', '3012f3d9-06e7-433d-8d21-dc5ab11a90dd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:23:20 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Delete snapshot completed successfully. Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7666a1c-8755-46be-854b-4e27b43ae94b tempest-ProjectMemberTests-476116560 None] Lock "cinder-244e83c4-6302-4c3c-bc17-d472c9ca26e8-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-86684c38-da33-4e25-b3b2-18f926860447-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-86684c38-da33-4e25-b3b2-18f926860447-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "cinder-quobyte-86684c38-da33-4e25-b3b2-18f926860447" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-86684c38-da33-4e25-b3b2-18f926860447" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8ee10e-2c6b-49ec-b1cf-3a585afbed63]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:23:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:20 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 Jul 11 04:23:20 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:21 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447" returned: 0 in 0.725s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:21 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447 Jul 11 04:23:21 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:22 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-86684c38-da33-4e25-b3b2-18f926860447" returned: 0 in 0.614s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-quobyte-86684c38-da33-4e25-b3b2-18f926860447" released by "delete_volume" :: held 1.391s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Created reservations ['cb8bdc8f-2a46-40e4-abff-cfbcf60795d9', 'd123060b-fe8c-4b50-98d5-e2e3071e22b9', '22ceb5e3-a4e9-4e17-b599-2b81cf0c89ba', '2d8c313b-1337-4e75-a6b8-7f0732268712'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:23:22 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:23:22 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:23:22 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.689s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:23:22 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Deleted volume successfully. Jul 11 04:23:22 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-93cf4f94-0fe3-4278-a466-ef8d0fffe1f6 tempest-ProjectMemberTests-476116560 None] Lock "cinder-86684c38-da33-4e25-b3b2-18f926860447-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:23:32 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=46,cinder:INSERT=25,cinder:UPDATE=76,cinder:DELETE=8 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:23:32 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=48,cinder:INSERT=10,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:23:46 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Flow 'volume_create_manager' (97097afd-5d66-4814-936b-7c97345c8359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fe9327-c3c1-4514-967b-d1cfb1249366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47fe9327-c3c1-4514-967b-d1cfb1249366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-102993902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231581a2-c860-45be-96da-8b3515d39e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eddcf5eb24d4ff9b0d559d68cb550d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:01Z,use_quota=True,user_id='5f78322848cd4deebf371f0bd7e771ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef541be4-7baa-46c9-9428-15d7a08ef426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef541be4-7baa-46c9-9428-15d7a08ef426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30f29d3-c709-463f-8207-73f6d0818bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30f29d3-c709-463f-8207-73f6d0818bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231581a2-c860-45be-96da-8b3515d39e22', 'volume_name': 'volume-231581a2-c860-45be-96da-8b3515d39e22', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878545ef-6a7f-4565-a14c-2aea0678a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878545ef-6a7f-4565-a14c-2aea0678a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2c6530-fbf6-4c20-a67e-82d47562987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:00 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Volume 231581a2-c860-45be-96da-8b3515d39e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231581a2-c860-45be-96da-8b3515d39e22', 'volume_size': 1} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-102993902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231581a2-c860-45be-96da-8b3515d39e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eddcf5eb24d4ff9b0d559d68cb550d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:01Z,use_quota=True,user_id='5f78322848cd4deebf371f0bd7e771ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)}" {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Creating volume 231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:24:00 devstack cinder-volume[87437]: INFO cinder.volume.drivers.remotefs [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] casted to osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 Jul 11 04:24:00 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 1073741824 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:00 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 1073741824 Jul 11 04:24:00 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:01 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 1073741824" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:01 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:01 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:01 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:02 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.623s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'} {{(pid=87437) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2c6530-fbf6-4c20-a67e-82d47562987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231581a2-c860-45be-96da-8b3515d39e22', 'volume_size': 1}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c49aa63-df8c-4391-9799-ba370135c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:02 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Volume volume-231581a2-c860-45be-96da-8b3515d39e22 (231581a2-c860-45be-96da-8b3515d39e22): created successfully Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c49aa63-df8c-4391-9799-ba370135c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Flow 'volume_create_manager' (97097afd-5d66-4814-936b-7c97345c8359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:02 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b9381d68-f274-429b-8586-1e61169a01fa tempest-SnapshotDependencyTests-1500429743 None] Created volume successfully. Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Creating offline snapshot f55422b2-03b5-4ed8-8f54-d8c92fba618a of volume 231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07ecf7-2b1b-4386-8002-f214e3269059]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:02 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:03 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:03 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:03 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.764s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:03 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a 1G {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:03 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a 1G Jul 11 04:24:03 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:04 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a 1G" returned: 0 in 0.791s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:04 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231581a2-c860-45be-96da-8b3515d39e22 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:04 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231581a2-c860-45be-96da-8b3515d39e22 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a Jul 11 04:24:04 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:05 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231581a2-c860-45be-96da-8b3515d39e22 -F qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a" returned: 0 in 0.651s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:05 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a is being set with open permissions: ugo+rw Jul 11 04:24:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:05 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a Jul 11 04:24:05 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:05 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a" returned: 0 in 0.643s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:05 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:05 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info Jul 11 04:24:05 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:06 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info" returned: 0 in 0.613s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:06 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info is being set with open permissions: ugo+rw Jul 11 04:24:06 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:06 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info Jul 11 04:24:06 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:07 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.info" returned: 0 in 0.625s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:07 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:07 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-46b4978e-83c0-4f7c-8d1c-29ee75c933bb tempest-SnapshotDependencyTests-1500429743 None] Create snapshot completed successfully Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87437) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Flow 'volume_create_manager' (5b000fbd-ac7e-46dc-bd24-31c74626b3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2504ba-19a9-401e-bccc-2aea88021ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2504ba-19a9-401e-bccc-2aea88021ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-11T02:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eddcf5eb24d4ff9b0d559d68cb550d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-11T02:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f55422b2-03b5-4ed8-8f54-d8c92fba618a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-11T02:24:09Z,use_quota=True,user_id='5f78322848cd4deebf371f0bd7e771ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5b1559-c7dc-4ed7-be5c-df60a379a228),volume_type_id=4e5b1559-c7dc-4ed7-be5c-df60a379a228)' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c67469-836a-4f67-9af3-fa7a58afa8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c67469-836a-4f67-9af3-fa7a58afa8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e34aa5-73f7-4662-ac37-071b7886c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e34aa5-73f7-4662-ac37-071b7886c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a', 'volume_name': 'volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a', 'volume_size': 1, 'snapshot_id': 'f55422b2-03b5-4ed8-8f54-d8c92fba618a'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec7a2a4-dcda-405d-939e-8f25ae177f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec7a2a4-dcda-405d-939e-8f25ae177f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e6b292-66bb-46be-9943-0c0cb18478e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:08 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Volume e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a', 'volume_size': 1, 'snapshot_id': 'f55422b2-03b5-4ed8-8f54-d8c92fba618a'} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-quobyte-f55422b2-03b5-4ed8-8f54-d8c92fba618a-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" by "_create_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-f55422b2-03b5-4ed8-8f54-d8c92fba618a-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Creating volume e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a from snapshot f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Selected osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948 as target Quobyte volume. {{(pid=87437) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-quobyte-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" by "_copy_volume_from_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] snapshot: f55422b2-03b5-4ed8-8f54-d8c92fba618a, volume: e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a, {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a8736e-a512-410b-8f87-485143f9d254]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:08 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:08 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a Jul 11 04:24:08 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:09 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a" returned: 0 in 0.721s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-231581a2-c860-45be-96da-8b3515d39e22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:24:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 11 04:24:09 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Creating direct copy from snapshot {{(pid=87437) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 11 04:24:09 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5777ee7-29ef-40a6-902e-63d3e0c02d1d]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:09 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:09 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:09 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:10 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.735s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:10 devstack cinder-volume[87437]: DEBUG cinder.utils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Path /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a not found in is_blk_device check {{(pid=87437) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 11 04:24:10 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:10 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a Jul 11 04:24:10 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:14 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:24:14 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:14 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" returned: 0 in 4.013s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e22fea2-92a8-4f86-bd3c-f9aea750f058]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:14 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:14 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:14 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.607s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG oslo_service.periodic_task [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] Running periodic task VolumeManager._thread_info {{(pid=87437) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread count: 9 {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 11 04:24:14 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-780856b8-2e85-4c84-93a1-7f8ad7cec273 None None] thread info: [<_MainThread(MainThread, started 129777216499840)>, , , , , , , , ] {{(pid=87437) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 11 04:24:15 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.876s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.image.image_utils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Image conversion details: src /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a {{(pid=87437) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:535}} Jul 11 04:24:15 devstack cinder-volume[87437]: INFO cinder.image.image_utils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Converted 1024.00 MB image at 255.10 MB/s Jul 11 04:24:15 devstack cinder-volume[87437]: WARNING cinder.volume.drivers.remotefs [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a is being set with open permissions: ugo+rw Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:15 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a Jul 11 04:24:15 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:15 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" returned: 0 in 0.600s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" released by "_copy_volume_from_snapshot" :: held 7.029s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-f55422b2-03b5-4ed8-8f54-d8c92fba618a-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" released by "_create_volume_from_snapshot" :: held 7.056s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.070s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e6b292-66bb-46be-9943-0c0cb18478e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a', 'volume_size': 1, 'snapshot_id': 'f55422b2-03b5-4ed8-8f54-d8c92fba618a'}' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a33cf4-d203-469f-91c4-edb870bf45c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 11 04:24:15 devstack cinder-volume[87437]: INFO cinder.volume.flows.manager.create_volume [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Volume volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a (e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a): created successfully Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a33cf4-d203-469f-91c4-edb870bf45c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87437) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 11 04:24:15 devstack cinder-volume[87437]: DEBUG cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Flow 'volume_create_manager' (5b000fbd-ac7e-46dc-bd24-31c74626b3cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87437) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 11 04:24:15 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-d7761c6f-0674-40cd-8c27-02732fd7b9d9 tempest-SnapshotDependencyTests-1500429743 None] Created volume successfully. Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-f55422b2-03b5-4ed8-8f54-d8c92fba618a-delete_snapshot" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-f55422b2-03b5-4ed8-8f54-d8c92fba618a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-quobyte-231581a2-c860-45be-96da-8b3515d39e22" by "delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-231581a2-c860-45be-96da-8b3515d39e22" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-quobyte-f55422b2-03b5-4ed8-8f54-d8c92fba618a" by "_delete_snapshot" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-f55422b2-03b5-4ed8-8f54-d8c92fba618a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Deleting offline snapshot f55422b2-03b5-4ed8-8f54-d8c92fba618a of volume 231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] snapshot_file for this snap is: volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449f4ad-fb63-49e5-a5f8-3e1f6047201e]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:16 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:16 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a Jul 11 04:24:16 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:17 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a" returned: 0 in 0.754s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:17 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.remotefs [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-231581a2-c860-45be-96da-8b3515d39e22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87437) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 11 04:24:17 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd1362a-1bde-4c76-b1e7-2eede06bce68]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:17 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:17 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:17 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.724s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:17 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:17 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a Jul 11 04:24:17 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:18 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a" returned: 0 in 0.711s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:18 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:18 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a Jul 11 04:24:18 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:19 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22.f55422b2-03b5-4ed8-8f54-d8c92fba618a" returned: 0 in 0.612s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-f55422b2-03b5-4ed8-8f54-d8c92fba618a" released by "_delete_snapshot" :: held 2.898s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-231581a2-c860-45be-96da-8b3515d39e22" released by "delete_snapshot" :: held 2.922s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Created reservations ['208b5a25-4a39-4a50-8a6e-83a411be81b2', 'f8103484-0aa5-4fdc-a707-41d6e82ea86b', 'a3edd089-02fd-4046-be08-7212000e2c5e', '1e3b0e55-4775-49f0-a5de-145ad2bc3969'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:19 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Delete snapshot completed successfully. Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-b7dace83-c707-424a-903b-bfc948b7210a tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-f55422b2-03b5-4ed8-8f54-d8c92fba618a-delete_snapshot" released by "delete_snapshot" :: held 3.049s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-231581a2-c860-45be-96da-8b3515d39e22-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-231581a2-c860-45be-96da-8b3515d39e22-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-quobyte-231581a2-c860-45be-96da-8b3515d39e22" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-231581a2-c860-45be-96da-8b3515d39e22" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[8415e13e-5450-4e59-a480-2f3b82b63716]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:19 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:19 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:19 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:20 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.729s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:20 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22 Jul 11 04:24:20 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:20 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:20 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-231581a2-c860-45be-96da-8b3515d39e22" returned: 0 in 0.630s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:20 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-231581a2-c860-45be-96da-8b3515d39e22" released by "delete_volume" :: held 1.416s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:20 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Created reservations ['4998cf18-0f1b-4163-bbe3-255638f8ba18', 'cfe00e89-eb49-4084-9703-1a2efc1b4621', '3df8ec26-ed84-409b-84d1-c785bcb9dcb8', '0410d164-8ce9-44ec-864a-de23636e3efd'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:21 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:24:21 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:21 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.625s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:21 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Deleted volume successfully. Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a-delete_volume" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-f57f5b83-cada-45e4-9e87-c1f9abb5e4a4 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-231581a2-c860-45be-96da-8b3515d39e22-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "cinder-quobyte-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" by "delete_volume" {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" acquired by "delete_volume" :: waited 0.014s {{(pid=87437) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a1383b-df81-4592-8b66-7b537ffa9c57]: (4, 'qcow2') {{(pid=88314) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 11 04:24:21 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:21 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a Jul 11 04:24:21 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:22 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" returned: 0 in 0.740s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:22 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:22 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a Jul 11 04:24:22 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:23 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174/volume-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" returned: 0 in 0.654s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-quobyte-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a" released by "delete_volume" :: held 1.432s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG cinder.quota [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Created reservations ['9e5cd926-593b-4c53-85a9-293a733dabf5', '25f4fe13-865a-41ad-8d3f-d2319011b750', '968433b0-a50d-4d43-af0f-838bcaa8252d', '9309f8d2-3473-4850-b28b-42391472b756'] {{(pid=87437) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948': None} {{(pid=87437) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5606ac82-6b62-454f-acbe-1e36562f3948'] {{(pid=87437) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.lockutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87437) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 11 04:24:23 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174 Jul 11 04:24:23 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 11 04:24:23 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG oslo_concurrency.processutils [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1ec9ef1ac3214d749d295065e0bc0174" returned: 0 in 0.684s {{(pid=87437) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG cinder.manager [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Notifying Schedulers of capabilities ... {{(pid=87437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 11 04:24:23 devstack cinder-volume[87437]: INFO cinder.volume.manager [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Deleted volume successfully. Jul 11 04:24:23 devstack cinder-volume[87437]: DEBUG cinder.coordination [None req-0d6e8b53-0fc0-470e-91ff-e13895884d58 tempest-SnapshotDependencyTests-1500429743 None] Lock "cinder-e0df9b7f-f2b3-400a-a4ff-4cfd08eba30a-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=87437) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 11 04:24:33 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 11 04:24:33 devstack cinder-volume[87437]: DEBUG dbcounter [-] [87437] Writing DB stats cinder:SELECT=22,cinder:INSERT=10,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=87437) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}